Nov 03 13:00:31 devstack cinder-volume[75682]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 13:00:31 devstack cinder-volume[75682]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 13:00:31 devstack cinder-volume[75682]: we strongly recommend against using it for new projects. Nov 03 13:00:31 devstack cinder-volume[75682]: If you are already using Eventlet, we recommend migrating to a different Nov 03 13:00:31 devstack cinder-volume[75682]: framework. For more detail see Nov 03 13:00:31 devstack cinder-volume[75682]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 13:00:31 devstack cinder-volume[75682]: import eventlet # noqa Nov 03 13:00:34 devstack cinder-volume[75682]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75682) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 13:00:34 devstack cinder-volume[75682]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75682) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 13:00:34 devstack cinder-volume[75682]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75682) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 13:00:35 devstack cinder-volume[75682]: INFO dbcounter [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] Registered counter for database cinder Nov 03 13:00:35 devstack cinder-volume[75682]: DEBUG oslo_db.sqlalchemy.engines [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75682) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG dbcounter [-] [75682] Writer thread running {{(pid=75682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 13:00:36 devstack cinder-volume[75682]: INFO cinder.rpc [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 13:00:36 devstack cinder-volume[75682]: INFO cinder.rpc [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_db.sqlalchemy.engines [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75682) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 13:00:36 devstack cinder-volume[75682]: INFO cinder.volume.manager [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] Determined volume DB was empty at startup. Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG cinder.volume.manager [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75682) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 13:00:36 devstack cinder-volume[75682]: INFO cinder.volume.manager [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 03 13:00:36 devstack cinder-volume[75682]: WARNING stevedore.named [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 13:00:36 devstack cinder-volume[75682]: WARNING castellan.key_manager [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 13:00:36 devstack cinder-volume[75682]: WARNING cinder.keymgr.conf_key_mgr [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG cinder.volume.drivers.lvm [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75682) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_concurrency.processutils [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] CMD "cinder-rtstool verify" returned: 0 in 0.397s {{(pid=75682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_db.sqlalchemy.engines [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75682) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 13:00:36 devstack cinder-volume[75682]: INFO cinder.rpc [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 03 13:00:36 devstack cinder-volume[75682]: INFO cinder.rpc [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 03 13:00:36 devstack cinder-volume[75682]: WARNING stevedore.named [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 13:00:36 devstack cinder-volume[75682]: WARNING castellan.key_manager [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 13:00:36 devstack cinder-volume[75682]: INFO cinder.volume.manager [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_db.sqlalchemy.engines [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75682) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 13:00:36 devstack cinder-volume[75682]: INFO oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] Starting 1 workers Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] Started child 75866 {{(pid=75682) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] Full set of CONF: {{(pid=75682) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] ******************************************************************************** {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] Configuration options gathered from: {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] ================================================================================ {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] allow_availability_zone_fallback = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] allow_compression_on_image_upload = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] allowed_direct_url_schemes = [] {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] api_rate_limit = True {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] auth_strategy = keystone {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] az_cache_duration = 3600 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_availability_zone = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_host = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_name = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_stats_polling_interval = 60 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backup_api_class = cinder.backup.api.API {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backup_name_template = backup-%s {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backup_use_same_host = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backup_use_temp_snapshot = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] chap_password = **** {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75866]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] chap_username = {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cinder_internal_tenant_project_id = cc9651d23ead4316b08d486f15d3a769 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cinder_internal_tenant_user_id = 788eed0a694a40dcbae7049654be1579 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cloned_volume_same_az = True {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cluster = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] compression_format = gzip {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] compute_api_class = cinder.compute.nova.API {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] config_dir = [] {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] config_source = [] {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] control_exchange = openstack {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] debug = True {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] default_availability_zone = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] default_group_type = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] default_volume_type = lvmdriver-1 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] disk_geometry = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] driver_client_cert = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] driver_client_cert_key = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] driver_data_namespace = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] driver_ssl_cert_path = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] driver_ssl_cert_verify = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] driver_use_ssl = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] enable_force_upload = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] enable_new_services = True {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] enable_unsupported_driver = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] enforce_multipath_for_image_xfer = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] filter_function = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] glance_api_insecure = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] glance_api_servers = ['http://192.168.122.253/image'] {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] glance_api_ssl_compression = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] glance_ca_certificates_file = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] glance_catalog_info = image:glance:publicURL {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] glance_certfile = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] glance_keyfile = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] glance_num_retries = 3 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] glance_request_timeout = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] goodness_function = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] graceful_shutdown_timeout = 5 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] group_api_class = cinder.group.api.API {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] host = devstack {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] image_compress_on_upload = True {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] image_conversion_address_space_limit = 1 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] image_conversion_cpu_limit = 60 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] image_conversion_disable = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] image_introspection_address_space_limit = 1 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] image_introspection_cpu_limit = 60 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] image_upload_use_cinder_backend = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] image_upload_use_internal_tenant = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] image_volume_cache_enabled = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] image_volume_cache_max_count = 0 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] image_volume_cache_max_size_gb = 0 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] init_host_max_objects_retrieval = 0 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] instance_format = [instance: %(uuid)s] {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] iscsi_target_flags = {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] iscsi_write_cache = on {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] iser_helper = tgtadm {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] iser_ip_address = 192.168.122.253 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] iser_port = 3260 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] log_color = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] log_config_append = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:36 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] log_dir = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] log_file = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] log_options = True {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] log_rotate_interval = 1 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] log_rotate_interval_type = days {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] log_rotation_type = none {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] max_age = 0 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] max_logfile_count = 30 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] max_logfile_size_mb = 200 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] max_over_subscription_ratio = 20.0 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] message_reap_interval = 86400 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] message_ttl = 2592000 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] migration_create_volume_timeout_secs = 300 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] monkey_patch = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] monkey_patch_modules = [] {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] my_ip = 192.168.122.253 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] no_snapshot_gb_quota = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] num_iser_scan_tries = 3 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] num_shell_tries = 3 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] num_volume_device_scan_tries = 3 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] nvmeof_conn_info_version = 1 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] nvmet_ns_id = 10 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] nvmet_port_id = 1 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] osapi_max_limit = 1000 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] osapi_volume_ext_list = [] {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] osapi_volume_listen_port = 8776 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] osapi_volume_use_ssl = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] osapi_volume_workers = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] per_volume_size_limit = -1 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] periodic_fuzzy_delay = 60 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] periodic_interval = 60 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] public_endpoint = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] publish_errors = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] quota_backup_gigabytes = 1000 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] quota_backups = 10 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] quota_gigabytes = 1000 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] quota_groups = 10 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] quota_snapshots = 10 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] quota_volumes = 10 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] rate_limit_burst = 0 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] rate_limit_except_level = CRITICAL {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] rate_limit_interval = 0 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] reinit_driver_count = 3 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] replication_device = **** {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] report_discard_supported = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] report_interval = 120 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] reservation_clean_interval = 86400 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] reservation_expire = 86400 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] reserved_image_namespaces = [] {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] reserved_percentage = 0 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] rpc_response_timeout = 120 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] run_external_periodic_tasks = True {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] scst_target_driver = iscsi {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] scst_target_iqn_name = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] service_down_time = 720 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] shell_completion = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] snapshot_name_template = snapshot-%s {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] snapshot_same_host = True {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] split_loggers = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] state_path = /opt/stack/data/cinder {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] storage_availability_zone = nova {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] storage_protocol = iSCSI {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] syslog_log_facility = LOG_USER {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] target_helper = lioadm {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] target_ip_address = 192.168.122.253 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] target_port = 3260 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] target_protocol = iscsi {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] target_secondary_ip_addresses = [] {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] trace_flags = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] transport_url = **** {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] until_refresh = 0 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] use_chap_auth = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] use_default_quota_class = True {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] use_journal = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] use_json = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] use_multipath_for_image_xfer = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] use_stderr = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] use_syslog = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] verify_glance_signatures = enabled {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] volume_api_class = cinder.volume.api.API {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] volume_backend_name = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] volume_clear = zero {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] volume_clear_ionice = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] volume_clear_size = 0 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] volume_copy_bps_limit = 0 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] volume_dd_blocksize = 1M {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] volume_name_template = volume-%s {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] volume_service_inithost_offload = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] volume_usage_audit_period = month {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] zoning_mode = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_concurrency.disable_process_locking = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.auth_section = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.auth_type = password {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.auth_version = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.cache = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.certfile = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.include_service_catalog = True {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.insecure = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.interface = public {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.keyfile = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.memcache_password = **** {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.memcache_username = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.region_name = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.service_type = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75866]: INFO cinder.volume.manager [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.253/identity {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.backend = dogpile.cache.null {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.backend_argument = **** {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.backend_expiration_time = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.config_prefix = cache.oslo {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.debug_cache_backend = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.enable_retry_client = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.enable_socket_keepalive = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.enabled = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.expiration_time = 600 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.hashclient_retry_attempts = 2 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.memcache_dead_retry = 300 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.memcache_pool_maxsize = 10 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.memcache_sasl_enabled = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.password = **** {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.proxies = [] {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.redis_db = 0 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.redis_server = localhost:6379 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.retry_attempts = 2 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.retry_delay = 0.0 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.socket_keepalive_count = 1 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.socket_keepalive_idle = 1 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.socket_keepalive_interval = 1 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.socket_timeout = 1.0 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.tls_allowed_ciphers = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.tls_cafile = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.tls_certfile = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.tls_enabled = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.tls_keyfile = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cache.username = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] coordination.backend_url = **** {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] database.asyncio_connection = **** {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] database.asyncio_slave_connection = **** {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] database.backend = sqlalchemy {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] database.connection = **** {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] database.connection_debug = 0 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] database.connection_parameters = {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] database.connection_recycle_time = 3600 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] database.connection_trace = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] database.db_inc_retry_interval = True {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] database.db_max_retries = 20 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] database.db_max_retry_interval = 10 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] database.db_retry_interval = 1 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] database.max_overflow = 50 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] database.max_pool_size = 5 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] database.max_retries = 10 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] database.mysql_wsrep_sync_wait = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] database.pool_timeout = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] database.retry_interval = 10 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] database.slave_connection = **** {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] database.sqlite_synchronous = True {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] database.synchronous_reader = True {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] database.use_db_reconnect = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_tracing.insecure = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] profiler.connection_string = messaging:// {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] profiler.enabled = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] profiler.es_doc_type = notification {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] profiler.es_scroll_size = 10000 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] profiler.es_scroll_time = 2m {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] profiler.filter_error_trace = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] profiler.hmac_keys = **** {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] profiler.sentinel_service_name = mymaster {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] profiler.socket_timeout = 0.1 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] profiler.trace_requests = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] profiler.trace_sqlalchemy = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] profiler_jaeger.process_tags = {} {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] profiler_jaeger.service_name_prefix = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] profiler_otlp.service_name_prefix = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_policy.enforce_new_defaults = True {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_policy.policy_default_rule = default {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_policy.policy_file = policy.yaml {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] privsep_osbrick.group = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] privsep_osbrick.helper_command = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] privsep_osbrick.user = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cinder_sys_admin.group = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cinder_sys_admin.helper_command = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] cinder_sys_admin.user = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] service_user.auth_section = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] service_user.auth_type = password {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] service_user.cafile = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] service_user.certfile = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] service_user.collect_timing = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] service_user.insecure = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] service_user.keyfile = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] service_user.send_service_user_token = True {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] service_user.split_loggers = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] service_user.timeout = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] service_user.tls_ciphers = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] service_user.tls_min_version = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] glance.auth_section = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] glance.auth_type = password {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] glance.certfile = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] glance.collect_timing = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] glance.insecure = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] glance.keyfile = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] glance.region_name = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] glance.split_loggers = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] glance.timeout = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] glance.tls_ciphers = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] glance.tls_min_version = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.backend_availability_zone = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.chap_password = **** {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.chap_username = {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.disk_geometry = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.driver_client_cert = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.driver_client_cert_key = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.driver_data_namespace = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.driver_use_ssl = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.extra_capabilities = {} {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.filter_function = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.goodness_function = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.iscsi_target_flags = {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.iscsi_write_cache = on {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.iser_helper = tgtadm {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.iser_ip_address = 192.168.122.253 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.iser_port = 3260 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.lvm_share_target = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.lvm_type = auto {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.070s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.num_shell_tries = 3 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.replication_device = **** {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.report_discard_supported = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.reserved_percentage = 0 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.target_helper = tgtadm {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.target_ip_address = 192.168.122.253 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.target_port = 3260 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.target_protocol = iscsi {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.trace_flags = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.unique_fqdn_network = True {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.use_chap_auth = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.volume_backend_name = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.volume_clear = zero {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.volume_clear_ionice = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.volume_clear_size = 0 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_reports.file_event_handler = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_reports.log_dir = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.backend_host = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.chap_password = **** {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.chap_username = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.disk_geometry = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.driver_client_cert = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.extra_capabilities = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.filter_function = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.goodness_function = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.iser_helper = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.iser_ip_address = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.iser_port = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.lvm_share_target = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.lvm_type = auto {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.num_shell_tries = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.replication_device = **** {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.report_discard_supported = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.reserved_percentage = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.scst_target_driver = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.storage_protocol = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.target_helper = lioadm {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.target_ip_address = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.target_port = 3260 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.trace_flags = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.use_chap_auth = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.volume_clear = zero {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack sudo[75898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.volume_clear_size = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack sudo[75898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] lvmdriver-1.volumes_dir = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.ssl = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_notifications.driver = [] {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_notifications.retry = -1 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] key_manager.fixed_key = **** {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] barbican.barbican_api_version = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] barbican.barbican_endpoint = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.053s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] barbican.barbican_endpoint_type = public {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] barbican.barbican_region_name = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] barbican.cafile = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] barbican.certfile = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] barbican.collect_timing = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] barbican.insecure = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] barbican.keyfile = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] barbican.number_of_retries = 60 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] barbican.retry_delay = 1 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] barbican.send_service_user_token = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] barbican.split_loggers = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] barbican.timeout = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] barbican.tls_ciphers = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] barbican.tls_min_version = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] barbican.verify_ssl = True {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] barbican.verify_ssl_path = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] barbican_service_user.auth_section = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] barbican_service_user.auth_type = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] barbican_service_user.cafile = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] barbican_service_user.certfile = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] barbican_service_user.collect_timing = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] barbican_service_user.insecure = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] barbican_service_user.keyfile = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] barbican_service_user.split_loggers = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] barbican_service_user.timeout = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] barbican_service_user.tls_ciphers = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] barbican_service_user.tls_min_version = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] vault.approle_role_id = **** {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] vault.approle_secret_id = **** {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] vault.auth_method = approle {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] vault.auth_path = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] vault.kv_mountpoint = secret {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] vault.kv_path = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] vault.kv_version = 2 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] vault.namespace = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] vault.root_token_id = **** {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] vault.ssl_ca_crt_file = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] vault.timeout = 60.0 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] vault.token_file = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] vault.token_role = None {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] vault.use_ssl = False {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:00:37 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] ******************************************************************************** {{(pid=75682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 13:00:37 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:37 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:37 devstack sudo[75898]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:37 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:37 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:37 devstack sudo[76024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 13:00:37 devstack sudo[76024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:37 devstack sudo[76024]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:37 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.260s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:37 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:00:37 devstack cinder-volume[75866]: INFO cinder.brick.local_dev.lvm [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 03 13:00:37 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:37 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:37 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:37 devstack sudo[76124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 13:00:37 devstack sudo[76124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:38 devstack sudo[76124]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:38 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:38 devstack cinder-volume[75866]: DEBUG cinder.brick.local_dev.lvm [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75866) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 03 13:00:38 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:38 devstack sudo[76213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 13:00:38 devstack sudo[76213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:38 devstack sudo[76213]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:38 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.552s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:38 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:38 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:38 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:38 devstack sudo[76403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 13:00:38 devstack sudo[76403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:38 devstack sudo[76403]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:38 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.338s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:38 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:38 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:38 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:39 devstack sudo[76483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 03 13:00:39 devstack sudo[76483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:39 devstack sudo[76483]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:39 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.314s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:39 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:39 devstack sudo[76558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 13:00:39 devstack sudo[76558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:39 devstack sudo[76558]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:39 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:39 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:39 devstack sudo[76571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 13:00:39 devstack sudo[76571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:39 devstack sudo[76571]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:39 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:39 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:39 devstack sudo[76580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 13:00:39 devstack sudo[76580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:40 devstack sudo[76580]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:40 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.331s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:40 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:40 devstack sudo[76663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 13:00:40 devstack sudo[76663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:40 devstack sudo[76663]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:40 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:40 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:40 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:40 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:40 devstack sudo[76667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 13:00:40 devstack sudo[76667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:40 devstack sudo[76667]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:40 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:40 devstack cinder-volume[75866]: INFO cinder.volume.drivers.lvm [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 03 13:00:40 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:40 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:40 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:40 devstack sudo[76671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 13:00:40 devstack sudo[76671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:41 devstack sudo[76671]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:41 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.306s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:41 devstack cinder-volume[75866]: DEBUG cinder.volume.drivers.lvm [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Updating volume stats {{(pid=75866) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 13:00:41 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:41 devstack sudo[76674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 13:00:41 devstack sudo[76674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:41 devstack sudo[76674]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:41 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:41 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:41 devstack sudo[76683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 13:00:41 devstack sudo[76683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:41 devstack sudo[76683]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:41 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:41 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:41 devstack sudo[76686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 13:00:41 devstack sudo[76686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:41 devstack sudo[76686]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:41 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:41 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:41 devstack sudo[76689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 13:00:41 devstack sudo[76689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:42 devstack sudo[76689]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:42 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:42 devstack cinder-volume[75866]: INFO cinder.volume.driver [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Driver hasn't implemented _init_vendor_properties() Nov 03 13:00:42 devstack cinder-volume[75866]: DEBUG cinder.volume.driver [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75866) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 13:00:42 devstack cinder-volume[75866]: DEBUG oslo_db.sqlalchemy.engines [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75866) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 13:00:42 devstack cinder-volume[75866]: DEBUG dbcounter [-] [75866] Writer thread running {{(pid=75866) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 13:00:42 devstack cinder-volume[75866]: DEBUG cinder.db.api [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Building query based on filter {{(pid=75866) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 03 13:00:42 devstack cinder-volume[75866]: DEBUG cinder.image.image_utils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75866) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 13:00:42 devstack cinder-volume[75866]: INFO cinder.keymgr.migration [None req-02152e0a-8a8b-43d9-aec2-e269b559fbe0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 13:00:42 devstack cinder-volume[75866]: DEBUG cinder.volume.drivers.lvm [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Updating volume stats {{(pid=75866) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 13:00:42 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:42 devstack sudo[76694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 13:00:42 devstack sudo[76694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:42 devstack sudo[76694]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:42 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.315s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:42 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:42 devstack sudo[76698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 13:00:42 devstack sudo[76698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:42 devstack sudo[76698]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:42 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:42 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:42 devstack sudo[76701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 13:00:42 devstack sudo[76701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:43 devstack sudo[76701]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:43 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.282s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:43 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:43 devstack sudo[76704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 13:00:43 devstack sudo[76704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:43 devstack sudo[76704]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:43 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.323s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:43 devstack cinder-volume[75866]: DEBUG cinder.manager [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Notifying Schedulers of capabilities ... {{(pid=75866) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:00:43 devstack cinder-volume[75866]: INFO cinder.volume.manager [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Driver initialization completed successfully. Nov 03 13:00:43 devstack cinder-volume[75866]: INFO cinder.manager [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Initiating service 2 cleanup Nov 03 13:00:43 devstack cinder-volume[75866]: INFO cinder.manager [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Service 2 cleanup completed. Nov 03 13:00:43 devstack cinder-volume[75866]: DEBUG cinder.service [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Creating RPC server for service cinder-volume {{(pid=75866) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 13:00:43 devstack cinder-volume[75866]: DEBUG cinder.service [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75866) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 13:00:43 devstack cinder-volume[75866]: INFO cinder.volume.manager [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 03 13:00:43 devstack cinder-volume[75866]: DEBUG cinder.volume.drivers.lvm [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Updating volume stats {{(pid=75866) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 13:00:43 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:43 devstack sudo[76709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 13:00:43 devstack sudo[76709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:43 devstack sudo[76709]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:43 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:43 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:43 devstack sudo[76712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 13:00:43 devstack sudo[76712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:44 devstack sudo[76712]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:44 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:44 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:44 devstack sudo[76715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 13:00:44 devstack sudo[76715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:44 devstack sudo[76715]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:44 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:44 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:44 devstack sudo[76718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 13:00:44 devstack sudo[76718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:44 devstack sudo[76718]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:44 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:44 devstack cinder-volume[75866]: INFO cinder.volume.manager [None req-c4a0ee08-a956-46df-860d-c3c13a28407c None None] Driver post RPC initialization completed successfully. Nov 03 13:00:46 devstack cinder-volume[75682]: DEBUG dbcounter [-] [75682] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:00:53 devstack cinder-volume[75866]: DEBUG dbcounter [-] [75866] Writing DB stats cinder:SELECT=3 {{(pid=75866) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:00:54 devstack cinder-volume[75866]: DEBUG dbcounter [-] [75866] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75866) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:01:05 devstack cinder-volume[75866]: DEBUG oslo_service.periodic_task [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] Running periodic task VolumeManager._thread_info {{(pid=75866) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:01:05 devstack cinder-volume[75866]: DEBUG cinder.volume.manager [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] thread count: 6 {{(pid=75866) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:01:05 devstack cinder-volume[75866]: DEBUG cinder.volume.manager [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] thread info: [<_MainThread(MainThread, started 129801982095488)>, , , , , ] {{(pid=75866) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:02:05 devstack cinder-volume[75866]: DEBUG oslo_service.periodic_task [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75866) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:02:05 devstack cinder-volume[75866]: DEBUG cinder.volume.drivers.lvm [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] Updating volume stats {{(pid=75866) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 13:02:05 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:05 devstack sudo[79254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 13:02:05 devstack sudo[79254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:06 devstack sudo[79254]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:06 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:06 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:06 devstack sudo[79257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 13:02:06 devstack sudo[79257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:06 devstack sudo[79257]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:06 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:06 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:06 devstack sudo[79260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 13:02:06 devstack sudo[79260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:06 devstack sudo[79260]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:06 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:06 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:06 devstack sudo[79263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 13:02:06 devstack sudo[79263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:06 devstack sudo[79263]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:06 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:06 devstack cinder-volume[75866]: DEBUG cinder.manager [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] Notifying Schedulers of capabilities ... {{(pid=75866) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:02:06 devstack cinder-volume[75866]: DEBUG oslo_service.periodic_task [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] Running periodic task VolumeManager._thread_info {{(pid=75866) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:02:06 devstack cinder-volume[75866]: DEBUG cinder.volume.manager [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] thread count: 6 {{(pid=75866) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:02:06 devstack cinder-volume[75866]: DEBUG cinder.volume.manager [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] thread info: [<_MainThread(MainThread, started 129801982095488)>, , , , , ] {{(pid=75866) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:02:54 devstack cinder-volume[75866]: DEBUG dbcounter [-] [75866] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75866) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:03:05 devstack cinder-volume[75866]: DEBUG oslo_service.periodic_task [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75866) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:03:05 devstack cinder-volume[75866]: DEBUG cinder.volume.drivers.lvm [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] Updating volume stats {{(pid=75866) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 13:03:05 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:03:05 devstack sudo[83114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 13:03:05 devstack sudo[83114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:03:06 devstack sudo[83114]: pam_unix(sudo:session): session closed for user root Nov 03 13:03:06 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:03:06 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:03:06 devstack sudo[83117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 13:03:06 devstack sudo[83117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:03:06 devstack sudo[83117]: pam_unix(sudo:session): session closed for user root Nov 03 13:03:06 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:03:06 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:03:06 devstack sudo[83120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 13:03:06 devstack sudo[83120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:03:06 devstack sudo[83120]: pam_unix(sudo:session): session closed for user root Nov 03 13:03:06 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:03:06 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:03:06 devstack sudo[83123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 13:03:06 devstack sudo[83123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:03:06 devstack sudo[83123]: pam_unix(sudo:session): session closed for user root Nov 03 13:03:06 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:03:06 devstack cinder-volume[75866]: DEBUG cinder.manager [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] Notifying Schedulers of capabilities ... {{(pid=75866) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:03:06 devstack cinder-volume[75866]: DEBUG oslo_service.periodic_task [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] Running periodic task VolumeManager._thread_info {{(pid=75866) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:03:06 devstack cinder-volume[75866]: DEBUG cinder.volume.manager [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] thread count: 6 {{(pid=75866) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:03:06 devstack cinder-volume[75866]: DEBUG cinder.volume.manager [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] thread info: [<_MainThread(MainThread, started 129801982095488)>, , , , , ] {{(pid=75866) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:04:05 devstack cinder-volume[75866]: DEBUG oslo_service.periodic_task [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75866) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:04:05 devstack cinder-volume[75866]: DEBUG cinder.volume.drivers.lvm [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] Updating volume stats {{(pid=75866) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 13:04:05 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:05 devstack sudo[84731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 13:04:05 devstack sudo[84731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:06 devstack sudo[84731]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:06 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:06 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:06 devstack sudo[84735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 13:04:06 devstack sudo[84735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:06 devstack sudo[84735]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:06 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:06 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:06 devstack sudo[84738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 13:04:06 devstack sudo[84738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:06 devstack sudo[84738]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:06 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:06 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:06 devstack sudo[84741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 13:04:06 devstack sudo[84741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:06 devstack sudo[84741]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:06 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:06 devstack cinder-volume[75866]: DEBUG cinder.manager [None req-5f2a8fe6-f566-493c-a914-ed32b518effc None None] Notifying Schedulers of capabilities ... {{(pid=75866) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:04:54 devstack cinder-volume[75866]: DEBUG dbcounter [-] [75866] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75866) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:05:03 devstack cinder-volume[75682]: INFO oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] Caught SIGTERM, stopping children Nov 03 13:05:03 devstack cinder-volume[75682]: DEBUG oslo_concurrency.lockutils [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] Acquiring lock "singleton_lock" {{(pid=75682) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 13:05:03 devstack cinder-volume[75682]: DEBUG oslo_concurrency.lockutils [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] Acquired lock "singleton_lock" {{(pid=75682) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 13:05:03 devstack cinder-volume[75682]: DEBUG oslo_concurrency.lockutils [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] Releasing lock "singleton_lock" {{(pid=75682) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 13:05:03 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] Stop services. {{(pid=75682) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 03 13:05:03 devstack cinder-volume[75682]: DEBUG oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] Killing children. {{(pid=75682) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 03 13:05:03 devstack cinder-volume[75682]: INFO oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] Waiting on 1 children to exit Nov 03 13:05:03 devstack cinder-volume[75866]: DEBUG oslo_concurrency.lockutils [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] Acquiring lock "singleton_lock" {{(pid=75866) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 13:05:03 devstack cinder-volume[75866]: DEBUG oslo_concurrency.lockutils [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] Acquired lock "singleton_lock" {{(pid=75866) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 13:05:03 devstack cinder-volume[75866]: DEBUG oslo_concurrency.lockutils [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] Releasing lock "singleton_lock" {{(pid=75866) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 13:05:03 devstack cinder-volume[75866]: WARNING amqp [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 13:05:03 devstack cinder-volume[75866]: WARNING amqp [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 13:05:03 devstack cinder-volume[75682]: INFO oslo_service.backend._eventlet.service [None req-cab44700-cb0b-4afa-9788-36203e652cc4 None None] Child 75866 exited with status 0 Nov 03 13:05:04 devstack cinder-volume[85898]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 13:05:04 devstack cinder-volume[85898]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 13:05:04 devstack cinder-volume[85898]: we strongly recommend against using it for new projects. Nov 03 13:05:04 devstack cinder-volume[85898]: If you are already using Eventlet, we recommend migrating to a different Nov 03 13:05:04 devstack cinder-volume[85898]: framework. For more detail see Nov 03 13:05:04 devstack cinder-volume[85898]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 13:05:04 devstack cinder-volume[85898]: import eventlet # noqa Nov 03 13:05:06 devstack cinder-volume[85898]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85898) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 13:05:06 devstack cinder-volume[85898]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85898) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 13:05:06 devstack cinder-volume[85898]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85898) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 13:05:06 devstack cinder-volume[85898]: INFO dbcounter [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] Registered counter for database cinder Nov 03 13:05:06 devstack cinder-volume[85898]: DEBUG oslo_db.sqlalchemy.engines [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85898) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG dbcounter [-] [85898] Writer thread running {{(pid=85898) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 13:05:07 devstack cinder-volume[85898]: INFO cinder.rpc [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 13:05:07 devstack cinder-volume[85898]: INFO cinder.rpc [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_db.sqlalchemy.engines [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85898) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 13:05:07 devstack cinder-volume[85898]: INFO cinder.volume.manager [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] Determined volume DB was empty at startup. Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG cinder.volume.manager [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85898) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 13:05:07 devstack cinder-volume[85898]: INFO cinder.volume.manager [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 03 13:05:07 devstack cinder-volume[85898]: WARNING stevedore.named [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 13:05:07 devstack cinder-volume[85898]: WARNING castellan.key_manager [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 13:05:07 devstack cinder-volume[85898]: WARNING cinder.keymgr.conf_key_mgr [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 13:05:07 devstack cinder-volume[85898]: INFO cinder.volume.manager [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_db.sqlalchemy.engines [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85898) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 13:05:07 devstack cinder-volume[85898]: INFO oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] Starting 1 workers Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] Started child 86114 {{(pid=85898) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] Full set of CONF: {{(pid=85898) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] ******************************************************************************** {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] Configuration options gathered from: {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] ================================================================================ {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] allow_availability_zone_fallback = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] allow_compression_on_image_upload = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] allowed_direct_url_schemes = [] {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] api_rate_limit = True {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] auth_strategy = keystone {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_availability_zone = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_host = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_name = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_stats_polling_interval = 60 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backup_api_class = cinder.backup.api.API {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backup_name_template = backup-%s {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backup_use_same_host = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backup_use_temp_snapshot = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] chap_password = **** {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] chap_username = {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cinder_internal_tenant_project_id = cc9651d23ead4316b08d486f15d3a769 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cinder_internal_tenant_user_id = 788eed0a694a40dcbae7049654be1579 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cluster = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] compression_format = gzip {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[86114]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] compute_api_class = cinder.compute.nova.API {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] config_dir = [] {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] config_source = [] {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] control_exchange = openstack {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] debug = True {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] default_availability_zone = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] default_group_type = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] default_volume_type = QuobyteHD {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] disk_geometry = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] driver_client_cert = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] driver_client_cert_key = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] driver_data_namespace = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] driver_ssl_cert_path = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] driver_ssl_cert_verify = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] driver_use_ssl = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] enable_new_services = True {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] enable_unsupported_driver = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] enabled_backends = ['QuobyteHD'] {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] enforce_multipath_for_image_xfer = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] filter_function = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] glance_api_insecure = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] glance_api_servers = ['http://192.168.122.253/image'] {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] glance_api_ssl_compression = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] glance_ca_certificates_file = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] glance_catalog_info = image:glance:publicURL {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] glance_certfile = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] glance_keyfile = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] glance_num_retries = 3 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] glance_request_timeout = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] goodness_function = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] graceful_shutdown_timeout = 5 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] group_api_class = cinder.group.api.API {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] host = devstack {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] image_compress_on_upload = True {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] image_conversion_address_space_limit = 1 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] image_conversion_cpu_limit = 60 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] image_conversion_disable = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] image_introspection_address_space_limit = 1 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] image_introspection_cpu_limit = 60 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] image_upload_use_cinder_backend = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] image_upload_use_internal_tenant = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] image_volume_cache_enabled = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] image_volume_cache_max_count = 0 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] image_volume_cache_max_size_gb = 0 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] init_host_max_objects_retrieval = 0 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] instance_format = [instance: %(uuid)s] {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] iscsi_target_flags = {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] iscsi_write_cache = on {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] iser_helper = tgtadm {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] iser_ip_address = 192.168.122.253 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] iser_port = 3260 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] log_color = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] log_config_append = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] log_dir = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] log_file = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] log_options = True {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] log_rotate_interval = 1 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] log_rotate_interval_type = days {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] log_rotation_type = none {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] max_age = 0 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] max_logfile_count = 30 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] max_logfile_size_mb = 200 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] max_over_subscription_ratio = 20.0 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] message_reap_interval = 86400 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] message_ttl = 2592000 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] migration_create_volume_timeout_secs = 300 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] monkey_patch = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] monkey_patch_modules = [] {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] my_ip = 192.168.122.253 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] no_snapshot_gb_quota = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] num_iser_scan_tries = 3 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] num_shell_tries = 3 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] num_volume_device_scan_tries = 3 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] nvmeof_conn_info_version = 1 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] nvmet_ns_id = 10 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] nvmet_port_id = 1 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] osapi_max_limit = 1000 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] osapi_volume_ext_list = [] {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] osapi_volume_listen_port = 8776 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] osapi_volume_use_ssl = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] osapi_volume_workers = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] per_volume_size_limit = -1 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] periodic_fuzzy_delay = 60 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] periodic_interval = 60 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] public_endpoint = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] publish_errors = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] quota_backup_gigabytes = 1000 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] quota_backups = 10 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] quota_gigabytes = 1000 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] quota_groups = 10 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] quota_snapshots = 10 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] quota_volumes = 10 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] rate_limit_burst = 0 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] rate_limit_except_level = CRITICAL {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] rate_limit_interval = 0 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] reinit_driver_count = 3 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] replication_device = **** {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] report_discard_supported = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] report_interval = 120 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] reservation_clean_interval = 86400 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] reservation_expire = 86400 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] reserved_image_namespaces = [] {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] reserved_percentage = 0 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] rpc_response_timeout = 120 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] run_external_periodic_tasks = True {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] scst_target_driver = iscsi {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] scst_target_iqn_name = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] service_down_time = 720 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] shell_completion = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] snapshot_name_template = snapshot-%s {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] split_loggers = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] state_path = /opt/stack/data/cinder {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] storage_availability_zone = nova {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] storage_protocol = iSCSI {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] syslog_log_facility = LOG_USER {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] target_helper = lioadm {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] target_ip_address = 192.168.122.253 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] target_port = 3260 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] target_protocol = iscsi {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] target_secondary_ip_addresses = [] {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] trace_flags = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] transport_url = **** {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] until_refresh = 0 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] use_chap_auth = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] use_default_quota_class = True {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] use_journal = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] use_json = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] use_multipath_for_image_xfer = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] use_stderr = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] use_syslog = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] verify_glance_signatures = enabled {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] volume_api_class = cinder.volume.api.API {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] volume_backend_name = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] volume_clear = zero {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] volume_clear_ionice = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[86114]: INFO cinder.volume.manager [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Starting volume driver QuobyteDriver (1.2.1) Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] volume_clear_size = 0 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[86114]: DEBUG cinder.volume.drivers.remotefs [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86114) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] volume_copy_bps_limit = 0 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] volume_dd_blocksize = 1M {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] volume_name_template = volume-%s {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] volume_service_inithost_offload = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] volume_usage_audit_period = month {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] zoning_mode = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_concurrency.disable_process_locking = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.auth_section = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.auth_type = password {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.auth_version = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.cache = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.certfile = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.include_service_catalog = True {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.insecure = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.interface = public {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.keyfile = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.memcache_password = **** {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.memcache_username = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.region_name = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.service_type = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.253/identity {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.backend = dogpile.cache.null {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.backend_argument = **** {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.backend_expiration_time = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.config_prefix = cache.oslo {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.debug_cache_backend = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.enable_retry_client = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.enable_socket_keepalive = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.enabled = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.expiration_time = 600 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.hashclient_retry_attempts = 2 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.memcache_dead_retry = 300 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.memcache_pool_maxsize = 10 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.memcache_sasl_enabled = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.password = **** {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.proxies = [] {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.redis_db = 0 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.redis_server = localhost:6379 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.retry_attempts = 2 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.retry_delay = 0.0 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.socket_keepalive_count = 1 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.socket_keepalive_idle = 1 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.socket_keepalive_interval = 1 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.socket_timeout = 1.0 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.tls_allowed_ciphers = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.tls_cafile = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.tls_certfile = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.tls_enabled = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.tls_keyfile = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cache.username = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] coordination.backend_url = **** {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] database.asyncio_connection = **** {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] database.asyncio_slave_connection = **** {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] database.backend = sqlalchemy {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] database.connection = **** {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] database.connection_debug = 0 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] database.connection_parameters = {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] database.connection_recycle_time = 3600 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] database.connection_trace = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] database.db_inc_retry_interval = True {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] database.db_max_retries = 20 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] database.db_max_retry_interval = 10 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] database.db_retry_interval = 1 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] database.max_overflow = 50 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] database.max_pool_size = 5 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] database.max_retries = 10 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] database.mysql_wsrep_sync_wait = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] database.pool_timeout = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] database.retry_interval = 10 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] database.slave_connection = **** {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] database.sqlite_synchronous = True {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] database.synchronous_reader = True {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] database.use_db_reconnect = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_tracing.insecure = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] profiler.connection_string = messaging:// {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] profiler.enabled = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] profiler.es_doc_type = notification {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] profiler.es_scroll_size = 10000 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] profiler.es_scroll_time = 2m {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] profiler.filter_error_trace = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] profiler.hmac_keys = **** {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] profiler.sentinel_service_name = mymaster {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] profiler.socket_timeout = 0.1 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] profiler.trace_requests = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] profiler.trace_sqlalchemy = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] profiler_jaeger.process_tags = {} {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] profiler_jaeger.service_name_prefix = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] profiler_otlp.service_name_prefix = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_policy.enforce_new_defaults = True {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_policy.policy_default_rule = default {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_policy.policy_file = policy.yaml {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] privsep_osbrick.group = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] privsep_osbrick.helper_command = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] privsep_osbrick.user = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cinder_sys_admin.group = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cinder_sys_admin.helper_command = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] cinder_sys_admin.user = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] service_user.auth_section = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] service_user.auth_type = password {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] service_user.cafile = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] service_user.certfile = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] service_user.collect_timing = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] service_user.insecure = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] service_user.keyfile = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] service_user.send_service_user_token = True {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] service_user.split_loggers = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] service_user.timeout = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] service_user.tls_ciphers = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] service_user.tls_min_version = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] glance.auth_section = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] glance.auth_type = password {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] glance.certfile = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] glance.collect_timing = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] glance.insecure = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] glance.keyfile = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] glance.region_name = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] glance.split_loggers = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] glance.timeout = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] glance.tls_ciphers = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] glance.tls_min_version = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.backend_availability_zone = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.chap_password = **** {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.chap_username = {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.disk_geometry = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.driver_client_cert = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.driver_client_cert_key = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.driver_data_namespace = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.driver_use_ssl = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.extra_capabilities = {} {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.filter_function = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.goodness_function = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.iscsi_target_flags = {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.iscsi_write_cache = on {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.iser_helper = tgtadm {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.iser_ip_address = 192.168.122.253 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.iser_port = 3260 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.nas_host = {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.nas_login = admin {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.nas_mount_options = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.nas_password = **** {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.nas_private_key = {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.nas_share_path = {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.num_shell_tries = 3 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.quobyte_volume_url = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.replication_device = **** {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.report_discard_supported = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.reserved_percentage = 0 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.target_helper = tgtadm {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.target_ip_address = 192.168.122.253 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.target_port = 3260 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.target_protocol = iscsi {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.trace_flags = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.unique_fqdn_network = True {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.use_chap_auth = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.volume_backend_name = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.volume_clear = zero {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.volume_clear_ionice = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.volume_clear_size = 0 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_reports.file_event_handler = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_reports.log_dir = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.backend_availability_zone = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.backend_host = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.chap_password = **** {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.chap_username = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.chiscsi_conf = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.disk_geometry = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.driver_client_cert = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.driver_data_namespace = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.driver_use_ssl = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.extra_capabilities = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.filter_function = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.goodness_function = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.iser_helper = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.iser_ip_address = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.iser_port = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.iser_target_prefix = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.nas_host = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.nas_login = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.nas_mount_options = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.nas_password = **** {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.nas_private_key = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.nas_share_path = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.nas_ssh_port = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.num_shell_tries = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.nvmet_port_id = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.replication_device = **** {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.report_discard_supported = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.reserved_percentage = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.scst_target_driver = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.storage_protocol = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.target_helper = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.target_ip_address = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.target_port = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.target_prefix = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.target_protocol = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.trace_flags = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.use_chap_auth = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.volume_clear = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.volume_clear_size = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] QuobyteHD.volumes_dir = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[86114]: DEBUG cinder.volume.drivers.quobyte [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86114) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.ssl = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_notifications.driver = [] {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_notifications.retry = -1 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] key_manager.fixed_key = **** {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] barbican.barbican_api_version = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] barbican.barbican_endpoint = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] barbican.barbican_endpoint_type = public {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] barbican.barbican_region_name = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] barbican.cafile = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] barbican.certfile = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[86114]: WARNING cinder.volume.drivers.quobyte [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 03 13:05:07 devstack cinder-volume[86114]: WARNING cinder.volume.drivers.quobyte [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] barbican.collect_timing = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] barbican.insecure = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[86114]: DEBUG oslo_concurrency.processutils [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Running cmd (subprocess): mount.quobyte {{(pid=86114) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] barbican.keyfile = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] barbican.number_of_retries = 60 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] barbican.retry_delay = 1 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] barbican.send_service_user_token = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] barbican.split_loggers = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] barbican.timeout = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] barbican.tls_ciphers = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] barbican.tls_min_version = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] barbican.verify_ssl = True {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] barbican.verify_ssl_path = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] barbican_service_user.auth_section = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] barbican_service_user.auth_type = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] barbican_service_user.cafile = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] barbican_service_user.certfile = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] barbican_service_user.collect_timing = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] barbican_service_user.insecure = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] barbican_service_user.keyfile = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] barbican_service_user.split_loggers = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] barbican_service_user.timeout = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] barbican_service_user.tls_ciphers = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] barbican_service_user.tls_min_version = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] vault.approle_role_id = **** {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] vault.approle_secret_id = **** {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] vault.auth_method = approle {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] vault.auth_path = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] vault.kv_mountpoint = secret {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] vault.kv_path = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] vault.kv_version = 2 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] vault.namespace = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] vault.root_token_id = **** {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] vault.ssl_ca_crt_file = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] vault.timeout = 60.0 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] vault.token_file = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] vault.token_role = None {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] vault.use_ssl = False {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:07 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] ******************************************************************************** {{(pid=85898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 13:05:07 devstack quobyte-client[86119]: Reading configuration file: /etc/quobyte/client.cfg Nov 03 13:05:07 devstack quobyte-client[86119]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 03 13:05:07 devstack cinder-volume[86114]: DEBUG oslo_concurrency.processutils [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] CMD "mount.quobyte" returned: 1 in 0.084s {{(pid=86114) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:07 devstack cinder-volume[86114]: DEBUG oslo_concurrency.lockutils [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86114) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:07 devstack cinder-volume[86114]: DEBUG oslo_concurrency.lockutils [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86114) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:07 devstack cinder-volume[86114]: DEBUG cinder.volume.drivers.quobyte [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:07 devstack cinder-volume[86114]: INFO cinder.volume.drivers.quobyte [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 ... Nov 03 13:05:07 devstack cinder-volume[86114]: DEBUG oslo_concurrency.processutils [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 -c /etc/quobyte/client-cinder.cfg {{(pid=86114) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:07 devstack sudo[86120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 -c /etc/quobyte/client-cinder.cfg Nov 03 13:05:07 devstack sudo[86120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:08 devstack sudo[86120]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:08 devstack cinder-volume[86114]: DEBUG oslo_concurrency.processutils [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.418s {{(pid=86114) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:08 devstack cinder-volume[86114]: INFO cinder.volume.drivers.quobyte [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 succeeded Nov 03 13:05:08 devstack cinder-volume[86114]: DEBUG cinder.volume.drivers.quobyte [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:08 devstack cinder-volume[86114]: DEBUG oslo_concurrency.lockutils [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.429s {{(pid=86114) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:08 devstack cinder-volume[86114]: DEBUG oslo_concurrency.processutils [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86114) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:08 devstack sudo[86222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:05:08 devstack sudo[86222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:08 devstack sudo[86222]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:08 devstack cinder-volume[86114]: DEBUG oslo_concurrency.processutils [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.236s {{(pid=86114) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:08 devstack cinder-volume[86114]: INFO cinder.volume.driver [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Driver hasn't implemented _init_vendor_properties() Nov 03 13:05:08 devstack cinder-volume[86114]: DEBUG cinder.volume.driver [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6806678771973, 'free_capacity_gb': 1773.6806678771973, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86114) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 13:05:08 devstack cinder-volume[86114]: DEBUG oslo_db.sqlalchemy.engines [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86114) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 13:05:08 devstack cinder-volume[86114]: DEBUG dbcounter [-] [86114] Writer thread running {{(pid=86114) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 13:05:08 devstack cinder-volume[86114]: DEBUG cinder.db.api [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Building query based on filter {{(pid=86114) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 03 13:05:08 devstack cinder-volume[86114]: DEBUG cinder.image.image_utils [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86114) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 13:05:08 devstack cinder-volume[86114]: INFO cinder.keymgr.migration [None req-29f27843-6d6c-4c27-9b16-410a4bce3c24 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 13:05:08 devstack cinder-volume[86114]: DEBUG oslo_concurrency.lockutils [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86114) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:08 devstack cinder-volume[86114]: DEBUG oslo_concurrency.lockutils [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86114) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:08 devstack cinder-volume[86114]: DEBUG cinder.volume.drivers.quobyte [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:08 devstack cinder-volume[86114]: DEBUG cinder.volume.drivers.quobyte [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:08 devstack cinder-volume[86114]: DEBUG oslo_concurrency.lockutils [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86114) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:08 devstack cinder-volume[86114]: DEBUG oslo_concurrency.processutils [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86114) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:08 devstack sudo[86225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:05:08 devstack sudo[86225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:08 devstack sudo[86225]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:08 devstack cinder-volume[86114]: DEBUG oslo_concurrency.processutils [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.235s {{(pid=86114) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:08 devstack cinder-volume[86114]: DEBUG cinder.manager [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Notifying Schedulers of capabilities ... {{(pid=86114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:05:08 devstack cinder-volume[86114]: INFO cinder.volume.manager [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Driver initialization completed successfully. Nov 03 13:05:08 devstack cinder-volume[86114]: INFO cinder.manager [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Initiating service 3 cleanup Nov 03 13:05:09 devstack cinder-volume[86114]: INFO cinder.manager [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Service 3 cleanup completed. Nov 03 13:05:09 devstack cinder-volume[86114]: DEBUG cinder.service [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Creating RPC server for service cinder-volume {{(pid=86114) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 13:05:09 devstack cinder-volume[86114]: DEBUG cinder.service [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86114) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 13:05:09 devstack cinder-volume[86114]: INFO cinder.volume.manager [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 03 13:05:09 devstack cinder-volume[86114]: DEBUG oslo_concurrency.lockutils [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86114) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:09 devstack cinder-volume[86114]: DEBUG oslo_concurrency.lockutils [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86114) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:09 devstack cinder-volume[86114]: DEBUG cinder.volume.drivers.quobyte [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:09 devstack cinder-volume[86114]: DEBUG cinder.volume.drivers.quobyte [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:09 devstack cinder-volume[86114]: DEBUG oslo_concurrency.lockutils [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86114) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:09 devstack cinder-volume[86114]: DEBUG oslo_concurrency.processutils [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86114) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:09 devstack sudo[86228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:05:09 devstack sudo[86228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:09 devstack sudo[86228]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:09 devstack cinder-volume[86114]: DEBUG oslo_concurrency.processutils [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.254s {{(pid=86114) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:09 devstack cinder-volume[86114]: INFO cinder.volume.manager [None req-f8230f9e-e964-4cf7-9796-69942c337c5d None None] Driver post RPC initialization completed successfully. Nov 03 13:05:13 devstack cinder-volume[85898]: INFO oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] Caught SIGTERM, stopping children Nov 03 13:05:13 devstack cinder-volume[85898]: DEBUG oslo_concurrency.lockutils [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] Acquiring lock "singleton_lock" {{(pid=85898) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 13:05:13 devstack cinder-volume[85898]: DEBUG oslo_concurrency.lockutils [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] Acquired lock "singleton_lock" {{(pid=85898) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 13:05:13 devstack cinder-volume[85898]: DEBUG oslo_concurrency.lockutils [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] Releasing lock "singleton_lock" {{(pid=85898) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 13:05:13 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] Stop services. {{(pid=85898) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 03 13:05:13 devstack cinder-volume[85898]: DEBUG oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] Killing children. {{(pid=85898) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 03 13:05:13 devstack cinder-volume[85898]: INFO oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] Waiting on 1 children to exit Nov 03 13:05:17 devstack cinder-volume[86114]: DEBUG oslo_concurrency.lockutils [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] Acquiring lock "singleton_lock" {{(pid=86114) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 13:05:17 devstack cinder-volume[86114]: DEBUG oslo_concurrency.lockutils [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] Acquired lock "singleton_lock" {{(pid=86114) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 13:05:17 devstack cinder-volume[86114]: DEBUG oslo_concurrency.lockutils [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] Releasing lock "singleton_lock" {{(pid=86114) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 13:05:17 devstack cinder-volume[86114]: WARNING amqp [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 13:05:17 devstack cinder-volume[86114]: WARNING amqp [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 13:05:17 devstack cinder-volume[85898]: INFO oslo_service.backend._eventlet.service [None req-63591eaa-40c8-443f-8484-b06a7e39a1f8 None None] Child 86114 exited with status 0 Nov 03 13:05:17 devstack cinder-volume[86432]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 13:05:17 devstack cinder-volume[86432]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 13:05:17 devstack cinder-volume[86432]: we strongly recommend against using it for new projects. Nov 03 13:05:17 devstack cinder-volume[86432]: If you are already using Eventlet, we recommend migrating to a different Nov 03 13:05:17 devstack cinder-volume[86432]: framework. For more detail see Nov 03 13:05:17 devstack cinder-volume[86432]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 13:05:17 devstack cinder-volume[86432]: import eventlet # noqa Nov 03 13:05:20 devstack cinder-volume[86432]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86432) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 13:05:20 devstack cinder-volume[86432]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86432) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 13:05:20 devstack cinder-volume[86432]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86432) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 13:05:20 devstack cinder-volume[86432]: INFO dbcounter [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] Registered counter for database cinder Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_db.sqlalchemy.engines [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86432) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG dbcounter [-] [86432] Writer thread running {{(pid=86432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 13:05:21 devstack cinder-volume[86432]: INFO cinder.rpc [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 13:05:21 devstack cinder-volume[86432]: INFO cinder.rpc [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_db.sqlalchemy.engines [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86432) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 13:05:21 devstack cinder-volume[86432]: INFO cinder.volume.manager [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] Determined volume DB was empty at startup. Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG cinder.volume.manager [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86432) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 13:05:21 devstack cinder-volume[86432]: WARNING stevedore.named [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 13:05:21 devstack cinder-volume[86432]: WARNING castellan.key_manager [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 13:05:21 devstack cinder-volume[86432]: WARNING cinder.keymgr.conf_key_mgr [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 13:05:21 devstack cinder-volume[86432]: INFO cinder.volume.manager [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_db.sqlalchemy.engines [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86432) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 13:05:21 devstack cinder-volume[86432]: INFO oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] Starting 1 workers Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] Started child 86725 {{(pid=86432) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] Full set of CONF: {{(pid=86432) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] ******************************************************************************** {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] Configuration options gathered from: {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] ================================================================================ {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] allow_availability_zone_fallback = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] allow_compression_on_image_upload = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] allowed_direct_url_schemes = [] {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] api_rate_limit = True {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] auth_strategy = keystone {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_availability_zone = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86725]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_host = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_name = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_stats_polling_interval = 60 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backup_api_class = cinder.backup.api.API {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backup_name_template = backup-%s {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backup_use_same_host = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backup_use_temp_snapshot = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] chap_password = **** {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] chap_username = {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cinder_internal_tenant_project_id = cc9651d23ead4316b08d486f15d3a769 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cinder_internal_tenant_user_id = 788eed0a694a40dcbae7049654be1579 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cluster = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] compression_format = gzip {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] compute_api_class = cinder.compute.nova.API {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] config_dir = [] {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] config_source = [] {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] control_exchange = openstack {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] debug = True {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] default_availability_zone = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] default_group_type = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] default_volume_type = QuobyteHD {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] disk_geometry = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] driver_client_cert = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] driver_client_cert_key = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] driver_data_namespace = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] driver_ssl_cert_path = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] driver_ssl_cert_verify = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] driver_use_ssl = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] enable_new_services = True {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] enable_unsupported_driver = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] enabled_backends = ['QuobyteHD'] {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] enforce_multipath_for_image_xfer = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] filter_function = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] glance_api_insecure = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] glance_api_servers = ['http://192.168.122.253/image'] {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] glance_api_ssl_compression = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] glance_ca_certificates_file = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] glance_catalog_info = image:glance:publicURL {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] glance_certfile = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] glance_keyfile = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] glance_num_retries = 3 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] glance_request_timeout = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] goodness_function = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] graceful_shutdown_timeout = 5 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] group_api_class = cinder.group.api.API {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] host = devstack {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] image_compress_on_upload = True {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] image_conversion_address_space_limit = 1 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] image_conversion_cpu_limit = 60 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] image_conversion_disable = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] image_introspection_address_space_limit = 1 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] image_introspection_cpu_limit = 60 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] image_upload_use_cinder_backend = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] image_upload_use_internal_tenant = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] image_volume_cache_enabled = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] image_volume_cache_max_count = 0 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] image_volume_cache_max_size_gb = 0 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] init_host_max_objects_retrieval = 0 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] instance_format = [instance: %(uuid)s] {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] iscsi_target_flags = {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] iscsi_write_cache = on {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] iser_helper = tgtadm {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] iser_ip_address = 192.168.122.253 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] iser_port = 3260 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] log_color = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] log_config_append = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] log_dir = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] log_file = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] log_options = True {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] log_rotate_interval = 1 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] log_rotate_interval_type = days {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] log_rotation_type = none {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] max_age = 0 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] max_logfile_count = 30 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] max_logfile_size_mb = 200 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] max_over_subscription_ratio = 20.0 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] message_reap_interval = 86400 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] message_ttl = 2592000 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] migration_create_volume_timeout_secs = 300 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] monkey_patch = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] monkey_patch_modules = [] {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] my_ip = 192.168.122.253 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] no_snapshot_gb_quota = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] num_iser_scan_tries = 3 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] num_shell_tries = 3 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] num_volume_device_scan_tries = 3 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] nvmeof_conn_info_version = 1 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] nvmet_ns_id = 10 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] nvmet_port_id = 1 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] osapi_max_limit = 1000 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] osapi_volume_ext_list = [] {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] osapi_volume_listen_port = 8776 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] osapi_volume_use_ssl = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] osapi_volume_workers = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] per_volume_size_limit = -1 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] periodic_fuzzy_delay = 60 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] periodic_interval = 60 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] public_endpoint = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] publish_errors = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] quota_backup_gigabytes = 1000 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] quota_backups = 10 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] quota_gigabytes = 1000 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] quota_groups = 10 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] quota_snapshots = 10 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] quota_volumes = 10 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] rate_limit_burst = 0 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] rate_limit_except_level = CRITICAL {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] rate_limit_interval = 0 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] reinit_driver_count = 3 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] replication_device = **** {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] report_discard_supported = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] report_interval = 120 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] reservation_clean_interval = 86400 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] reservation_expire = 86400 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] reserved_image_namespaces = [] {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] reserved_percentage = 0 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] rpc_response_timeout = 120 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] run_external_periodic_tasks = True {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] Starting volume driver QuobyteDriver (1.2.1) Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] scst_target_driver = iscsi {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] scst_target_iqn_name = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] service_down_time = 720 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] shell_completion = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] snapshot_name_template = snapshot-%s {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] split_loggers = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86725) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] state_path = /opt/stack/data/cinder {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] storage_availability_zone = nova {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] storage_protocol = iSCSI {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] syslog_log_facility = LOG_USER {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] target_helper = lioadm {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] target_ip_address = 192.168.122.253 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] target_port = 3260 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] target_protocol = iscsi {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] target_secondary_ip_addresses = [] {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] trace_flags = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] transport_url = **** {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] until_refresh = 0 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] use_chap_auth = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] use_default_quota_class = True {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] use_journal = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] use_json = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] use_multipath_for_image_xfer = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] use_stderr = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] use_syslog = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] verify_glance_signatures = enabled {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] volume_api_class = cinder.volume.api.API {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] volume_backend_name = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] volume_clear = zero {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] volume_clear_ionice = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] volume_clear_size = 0 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] volume_copy_bps_limit = 0 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] volume_dd_blocksize = 1M {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] volume_name_template = volume-%s {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] volume_service_inithost_offload = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] volume_usage_audit_period = month {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] zoning_mode = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_concurrency.disable_process_locking = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.auth_section = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.auth_type = password {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.auth_version = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.cache = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.certfile = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.include_service_catalog = True {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.insecure = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.interface = public {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.keyfile = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.memcache_password = **** {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.memcache_username = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.region_name = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.service_type = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.253/identity {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.backend = dogpile.cache.null {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.backend_argument = **** {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.backend_expiration_time = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.config_prefix = cache.oslo {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.debug_cache_backend = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.enable_retry_client = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.enable_socket_keepalive = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.enabled = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.expiration_time = 600 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.hashclient_retry_attempts = 2 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.memcache_dead_retry = 300 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.memcache_pool_maxsize = 10 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.memcache_sasl_enabled = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.password = **** {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.proxies = [] {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.redis_db = 0 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.redis_server = localhost:6379 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.retry_attempts = 2 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.retry_delay = 0.0 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.socket_keepalive_count = 1 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.socket_keepalive_idle = 1 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.socket_keepalive_interval = 1 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.socket_timeout = 1.0 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.tls_allowed_ciphers = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.tls_cafile = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.tls_certfile = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.tls_enabled = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.tls_keyfile = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cache.username = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] coordination.backend_url = **** {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] database.asyncio_connection = **** {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] database.asyncio_slave_connection = **** {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] database.backend = sqlalchemy {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] database.connection = **** {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] database.connection_debug = 0 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] database.connection_parameters = {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] database.connection_recycle_time = 3600 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] database.connection_trace = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] database.db_inc_retry_interval = True {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] database.db_max_retries = 20 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] database.db_max_retry_interval = 10 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] database.db_retry_interval = 1 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] database.max_overflow = 50 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] database.max_pool_size = 5 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] database.max_retries = 10 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] database.mysql_wsrep_sync_wait = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] database.pool_timeout = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] database.retry_interval = 10 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] database.slave_connection = **** {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] database.sqlite_synchronous = True {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] database.synchronous_reader = True {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] database.use_db_reconnect = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_tracing.insecure = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] profiler.connection_string = messaging:// {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] profiler.enabled = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] profiler.es_doc_type = notification {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] profiler.es_scroll_size = 10000 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] profiler.es_scroll_time = 2m {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] profiler.filter_error_trace = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] profiler.hmac_keys = **** {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] profiler.sentinel_service_name = mymaster {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] profiler.socket_timeout = 0.1 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] profiler.trace_requests = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] profiler.trace_sqlalchemy = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] profiler_jaeger.process_tags = {} {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] profiler_jaeger.service_name_prefix = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] profiler_otlp.service_name_prefix = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_policy.enforce_new_defaults = True {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_policy.policy_default_rule = default {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_policy.policy_file = policy.yaml {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] privsep_osbrick.group = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] privsep_osbrick.helper_command = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86725) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] privsep_osbrick.user = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cinder_sys_admin.group = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cinder_sys_admin.helper_command = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] cinder_sys_admin.user = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] service_user.auth_section = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] service_user.auth_type = password {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] service_user.cafile = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] service_user.certfile = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] service_user.collect_timing = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] service_user.insecure = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] service_user.keyfile = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] service_user.send_service_user_token = True {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] service_user.split_loggers = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] service_user.timeout = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] service_user.tls_ciphers = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.quobyte [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] service_user.tls_min_version = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.quobyte [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] glance.auth_section = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] glance.auth_type = password {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] glance.certfile = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] glance.collect_timing = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] glance.insecure = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] glance.keyfile = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] glance.region_name = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] glance.split_loggers = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] Running cmd (subprocess): mount.quobyte {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] glance.timeout = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] glance.tls_ciphers = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] glance.tls_min_version = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.backend_availability_zone = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.chap_password = **** {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.chap_username = {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.disk_geometry = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.driver_client_cert = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.driver_client_cert_key = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.driver_data_namespace = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.driver_use_ssl = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.extra_capabilities = {} {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.filter_function = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.goodness_function = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.iscsi_target_flags = {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.iscsi_write_cache = on {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.iser_helper = tgtadm {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.iser_ip_address = 192.168.122.253 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.iser_port = 3260 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.nas_host = {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.nas_login = admin {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.nas_mount_options = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.nas_password = **** {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.nas_private_key = {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.nas_share_path = {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.num_shell_tries = 3 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.quobyte_volume_url = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.replication_device = **** {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.report_discard_supported = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.reserved_percentage = 0 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.target_helper = tgtadm {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.target_ip_address = 192.168.122.253 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.target_port = 3260 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.target_protocol = iscsi {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.trace_flags = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.unique_fqdn_network = True {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.use_chap_auth = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.volume_backend_name = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.volume_clear = zero {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.volume_clear_ionice = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.volume_clear_size = 0 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_reports.file_event_handler = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_reports.log_dir = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.backend_availability_zone = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.backend_host = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.chap_password = **** {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.chap_username = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.chiscsi_conf = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.disk_geometry = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.driver_client_cert = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.driver_data_namespace = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.driver_use_ssl = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.extra_capabilities = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.filter_function = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.goodness_function = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.iser_helper = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.iser_ip_address = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.iser_port = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.iser_target_prefix = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.nas_host = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.nas_login = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.nas_mount_options = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.nas_password = **** {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.nas_private_key = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.nas_share_path = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.nas_ssh_port = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.num_shell_tries = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.nvmet_port_id = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.replication_device = **** {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.report_discard_supported = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.reserved_percentage = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.scst_target_driver = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.storage_protocol = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.target_helper = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.target_ip_address = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.target_port = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.target_prefix = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.target_protocol = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.trace_flags = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.use_chap_auth = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.volume_clear = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.volume_clear_size = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] QuobyteHD.volumes_dir = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.ssl = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_notifications.driver = [] {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_notifications.retry = -1 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] key_manager.fixed_key = **** {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] barbican.barbican_api_version = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] barbican.barbican_endpoint = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] barbican.barbican_endpoint_type = public {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] barbican.barbican_region_name = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] barbican.cafile = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] barbican.certfile = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] barbican.collect_timing = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] barbican.insecure = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] barbican.keyfile = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] barbican.number_of_retries = 60 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] barbican.retry_delay = 1 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] barbican.send_service_user_token = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack quobyte-client[86729]: Reading configuration file: /etc/quobyte/client.cfg Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] barbican.split_loggers = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] barbican.timeout = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] barbican.tls_ciphers = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] barbican.tls_min_version = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] barbican.verify_ssl = True {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] barbican.verify_ssl_path = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] barbican_service_user.auth_section = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack quobyte-client[86729]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] barbican_service_user.auth_type = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] barbican_service_user.cafile = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] barbican_service_user.certfile = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] barbican_service_user.collect_timing = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] barbican_service_user.insecure = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] barbican_service_user.keyfile = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] barbican_service_user.split_loggers = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] barbican_service_user.timeout = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] barbican_service_user.tls_ciphers = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] barbican_service_user.tls_min_version = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] vault.approle_role_id = **** {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] vault.approle_secret_id = **** {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] vault.auth_method = approle {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] vault.auth_path = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] vault.kv_mountpoint = secret {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] vault.kv_path = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] vault.kv_version = 2 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] vault.namespace = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] vault.root_token_id = **** {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] vault.ssl_ca_crt_file = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] vault.timeout = 60.0 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] vault.token_file = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] vault.token_role = None {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] vault.use_ssl = False {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 13:05:21 devstack cinder-volume[86432]: DEBUG oslo_service.backend._eventlet.service [None req-48ef8945-18af-4521-a61c-1d3a2fd62720 None None] ******************************************************************************** {{(pid=86432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 13:05:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] CMD "mount.quobyte" returned: 1 in 0.091s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:21 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:21 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:21 devstack sudo[86730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:05:21 devstack sudo[86730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:22 devstack sudo[86730]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.238s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:22 devstack cinder-volume[86725]: INFO cinder.volume.driver [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] Driver hasn't implemented _init_vendor_properties() Nov 03 13:05:22 devstack cinder-volume[86725]: DEBUG cinder.volume.driver [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7062873840332, 'free_capacity_gb': 1773.7062873840332, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86725) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 13:05:22 devstack cinder-volume[86725]: DEBUG oslo_db.sqlalchemy.engines [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86725) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 13:05:22 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writer thread running {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 13:05:22 devstack cinder-volume[86725]: DEBUG cinder.db.api [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] Building query based on filter {{(pid=86725) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 03 13:05:22 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86725) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 13:05:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:22 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:22 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:22 devstack cinder-volume[86725]: INFO cinder.keymgr.migration [None req-d5358408-b295-4eb4-9566-a4bb245aa343 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 13:05:22 devstack sudo[86741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:05:22 devstack sudo[86741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:22 devstack sudo[86741]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.228s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:22 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:05:22 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] Driver initialization completed successfully. Nov 03 13:05:22 devstack cinder-volume[86725]: INFO cinder.manager [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] Initiating service 3 cleanup Nov 03 13:05:22 devstack cinder-volume[86725]: INFO cinder.manager [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] Service 3 cleanup completed. Nov 03 13:05:22 devstack cinder-volume[86725]: DEBUG cinder.service [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] Creating RPC server for service cinder-volume {{(pid=86725) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 13:05:22 devstack cinder-volume[86725]: DEBUG cinder.service [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86725) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 13:05:22 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 03 13:05:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:22 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:22 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:22 devstack sudo[86752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:05:22 devstack sudo[86752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:22 devstack sudo[86752]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.270s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:22 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-b47525b2-25b6-4ede-8c4d-dc64535c7c7f None None] Driver post RPC initialization completed successfully. Nov 03 13:05:31 devstack cinder-volume[86432]: DEBUG dbcounter [-] [86432] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:05:32 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:05:32 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=2 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:05:58 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager._thread_info {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:05:58 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread count: 6 {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:05:58 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread info: [<_MainThread(MainThread, started 133507074375808)>, , , , , ] {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:06:40 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:06:40 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] Flow 'volume_create_manager' (6fa562ef-fc72-4de3-a6b0-1919c492555a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:06:40 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64379c25-4d4e-42a3-afdb-265ef6a1b684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:40 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64379c25-4d4e-42a3-afdb-265ef6a1b684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-832403835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d06b4b99-e2c7-43a5-bfd0-ba0331fca6b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83abe32e004c438ba3b3455d7fdcbfba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:06:40Z,use_quota=True,user_id='52ca764bf84c43aa8e224b9dadd04661',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:40 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a85ab5-445f-4a08-92ba-37bdf41b6c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:40 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a85ab5-445f-4a08-92ba-37bdf41b6c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:40 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b2d828b-6d94-4bf7-a77c-adf9186c74cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:40 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b2d828b-6d94-4bf7-a77c-adf9186c74cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd06b4b99-e2c7-43a5-bfd0-ba0331fca6b4', 'volume_name': 'volume-d06b4b99-e2c7-43a5-bfd0-ba0331fca6b4', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:40 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a591a2-7e07-41e9-915b-7da1130019b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:40 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a591a2-7e07-41e9-915b-7da1130019b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:40 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b800a5-0841-48ea-a094-4e259a77b7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:40 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] Volume d06b4b99-e2c7-43a5-bfd0-ba0331fca6b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d06b4b99-e2c7-43a5-bfd0-ba0331fca6b4', 'volume_size': 1} Nov 03 13:06:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:40 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-832403835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d06b4b99-e2c7-43a5-bfd0-ba0331fca6b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83abe32e004c438ba3b3455d7fdcbfba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:06:40Z,use_quota=True,user_id='52ca764bf84c43aa8e224b9dadd04661',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:06:40 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] Creating volume d06b4b99-e2c7-43a5-bfd0-ba0331fca6b4 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:06:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:40 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:06:40 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:06:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:40 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:06:40 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:06:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d06b4b99-e2c7-43a5-bfd0-ba0331fca6b4 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:41 devstack sudo[87606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d06b4b99-e2c7-43a5-bfd0-ba0331fca6b4 1073741824 Nov 03 13:06:41 devstack sudo[87606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:42 devstack sudo[87606]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d06b4b99-e2c7-43a5-bfd0-ba0331fca6b4 1073741824" returned: 0 in 1.445s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d06b4b99-e2c7-43a5-bfd0-ba0331fca6b4 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:42 devstack sudo[87949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d06b4b99-e2c7-43a5-bfd0-ba0331fca6b4 Nov 03 13:06:42 devstack sudo[87949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:43 devstack sudo[87949]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d06b4b99-e2c7-43a5-bfd0-ba0331fca6b4" returned: 0 in 0.565s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:43 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] <== create_volume: return (2117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:06:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.124s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b800a5-0841-48ea-a094-4e259a77b7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d06b4b99-e2c7-43a5-bfd0-ba0331fca6b4', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec807887-ec12-4596-8906-d8028e56b76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:43 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] Volume volume-d06b4b99-e2c7-43a5-bfd0-ba0331fca6b4 (d06b4b99-e2c7-43a5-bfd0-ba0331fca6b4): created successfully Nov 03 13:06:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec807887-ec12-4596-8906-d8028e56b76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] Flow 'volume_create_manager' (6fa562ef-fc72-4de3-a6b0-1919c492555a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:06:43 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-3afacf60-b247-44ae-a737-a11c9577ce4b tempest-DeleteServersTestJSON-1940532783 None] Created volume successfully. Nov 03 13:06:46 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:06:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] Flow 'volume_create_manager' (e976aaa7-eebb-4141-9205-3c95daf45d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:06:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c54b917-5b99-459c-8638-9d43d13e6837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c54b917-5b99-459c-8638-9d43d13e6837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2025718992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb823302-b544-45c1-892a-fc68919c10c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7025c272eac34f2296ea53466c6f05c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:06:46Z,use_quota=True,user_id='b3a866701e6041f98eca7e977d220b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4b805a-b9de-415f-8e42-06547fa9024d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4b805a-b9de-415f-8e42-06547fa9024d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a24bc7a2-46a5-4b86-adbb-61b0c8e5df55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a24bc7a2-46a5-4b86-adbb-61b0c8e5df55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb823302-b544-45c1-892a-fc68919c10c3', 'volume_name': 'volume-eb823302-b544-45c1-892a-fc68919c10c3', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dccc098-3a96-49cd-8e02-f4bcbf521f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dccc098-3a96-49cd-8e02-f4bcbf521f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52a9890d-bbcb-46c2-897e-d2f74283081d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:46 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] Volume eb823302-b544-45c1-892a-fc68919c10c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb823302-b544-45c1-892a-fc68919c10c3', 'volume_size': 1} Nov 03 13:06:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:46 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2025718992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb823302-b544-45c1-892a-fc68919c10c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7025c272eac34f2296ea53466c6f05c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:06:46Z,use_quota=True,user_id='b3a866701e6041f98eca7e977d220b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:06:46 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] Creating volume eb823302-b544-45c1-892a-fc68919c10c3 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:06:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:46 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:06:46 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:06:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:46 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:06:46 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:06:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-eb823302-b544-45c1-892a-fc68919c10c3 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:46 devstack sudo[87987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-eb823302-b544-45c1-892a-fc68919c10c3 1073741824 Nov 03 13:06:46 devstack sudo[87987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:47 devstack sudo[87987]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-eb823302-b544-45c1-892a-fc68919c10c3 1073741824" returned: 0 in 0.931s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-eb823302-b544-45c1-892a-fc68919c10c3 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:47 devstack sudo[87996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-eb823302-b544-45c1-892a-fc68919c10c3 Nov 03 13:06:47 devstack sudo[87996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:48 devstack sudo[87996]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-eb823302-b544-45c1-892a-fc68919c10c3" returned: 0 in 0.723s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:48 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:06:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.808s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:48 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52a9890d-bbcb-46c2-897e-d2f74283081d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb823302-b544-45c1-892a-fc68919c10c3', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:48 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (361f0b89-154c-4c3b-9974-51f3c62be52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:48 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] Volume volume-eb823302-b544-45c1-892a-fc68919c10c3 (eb823302-b544-45c1-892a-fc68919c10c3): created successfully Nov 03 13:06:48 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (361f0b89-154c-4c3b-9974-51f3c62be52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:48 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] Flow 'volume_create_manager' (e976aaa7-eebb-4141-9205-3c95daf45d8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:06:48 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-508df356-27a0-4316-9479-e1fb12453d93 tempest-VolumesAdminNegativeTest-1679709595 None] Created volume successfully. Nov 03 13:06:49 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:06:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] Flow 'volume_create_manager' (24a24dc6-1b26-4208-8b07-9bc4a07cf857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:06:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (865b83ce-ff87-4cff-a735-1b629f81c46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (865b83ce-ff87-4cff-a735-1b629f81c46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-135205670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f0394a-220b-4064-96c4-a74f52b22d44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5c988f51ff04deca721d2436e231f42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:06:49Z,use_quota=True,user_id='99b18e7159774f30a3d3036a3af801fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e78fad53-bbe9-40bc-a09b-487087013bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e78fad53-bbe9-40bc-a09b-487087013bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec94a78-aa3e-4fac-87c7-e3fa00ce3dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec94a78-aa3e-4fac-87c7-e3fa00ce3dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97f0394a-220b-4064-96c4-a74f52b22d44', 'volume_name': 'volume-97f0394a-220b-4064-96c4-a74f52b22d44', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f9f79ef-5c5f-4096-8e74-5609d4559b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f9f79ef-5c5f-4096-8e74-5609d4559b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e70026c-2d87-447e-bf74-64797be02541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:49 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] Volume 97f0394a-220b-4064-96c4-a74f52b22d44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97f0394a-220b-4064-96c4-a74f52b22d44', 'volume_size': 1} Nov 03 13:06:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-135205670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f0394a-220b-4064-96c4-a74f52b22d44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5c988f51ff04deca721d2436e231f42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:06:49Z,use_quota=True,user_id='99b18e7159774f30a3d3036a3af801fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:06:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] Creating volume 97f0394a-220b-4064-96c4-a74f52b22d44 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:06:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:06:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:06:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:06:49 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:06:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-97f0394a-220b-4064-96c4-a74f52b22d44 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:49 devstack sudo[88035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-97f0394a-220b-4064-96c4-a74f52b22d44 1073741824 Nov 03 13:06:49 devstack sudo[88035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4c304590-b1eb-472c-a5eb-81371bec71c1 tempest-VolumesAdminNegativeTest-1679709595 None] Acquiring lock "cinder-eb823302-b544-45c1-892a-fc68919c10c3-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4c304590-b1eb-472c-a5eb-81371bec71c1 tempest-VolumesAdminNegativeTest-1679709595 None] Lock "cinder-eb823302-b544-45c1-892a-fc68919c10c3-delete_volume" acquired by "delete_volume" :: waited 0.132s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4c304590-b1eb-472c-a5eb-81371bec71c1 tempest-VolumesAdminNegativeTest-1679709595 None] Acquiring lock "cinder-quobyte-eb823302-b544-45c1-892a-fc68919c10c3" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4c304590-b1eb-472c-a5eb-81371bec71c1 tempest-VolumesAdminNegativeTest-1679709595 None] Lock "cinder-quobyte-eb823302-b544-45c1-892a-fc68919c10c3" acquired by "delete_volume" :: waited 0.084s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:50 devstack cinder-volume[86725]: INFO oslo.privsep.daemon [None req-4c304590-b1eb-472c-a5eb-81371bec71c1 tempest-VolumesAdminNegativeTest-1679709595 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp4ngyihbq/privsep.sock'] Nov 03 13:06:50 devstack sudo[88052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp4ngyihbq/privsep.sock Nov 03 13:06:50 devstack sudo[88052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:51 devstack sudo[88035]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:51 devstack cinder-volume[86725]: WARNING py.warnings [req-7f51ab9b-0811-404c-a697-e36cc36f3f28 req-1ca2a979-09bf-4b7a-a6bd-86b0ad16e2e9 tempest-DeleteServersTestJSON-1940532783 None] /opt/stack/cinder/cinder/db/api.py:2442: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Nov 03 13:06:51 devstack cinder-volume[86725]: .first() Nov 03 13:06:51 devstack cinder-volume[86725]: Nov 03 13:06:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-97f0394a-220b-4064-96c4-a74f52b22d44 1073741824" returned: 0 in 1.349s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-7f51ab9b-0811-404c-a697-e36cc36f3f28 req-1ca2a979-09bf-4b7a-a6bd-86b0ad16e2e9 tempest-DeleteServersTestJSON-1940532783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-97f0394a-220b-4064-96c4-a74f52b22d44 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:51 devstack sudo[88058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-97f0394a-220b-4064-96c4-a74f52b22d44 Nov 03 13:06:51 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:52 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-97f0394a-220b-4064-96c4-a74f52b22d44" returned: 0 in 0.669s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:52 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] <== create_volume: return (2304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:06:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.308s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-7f51ab9b-0811-404c-a697-e36cc36f3f28 req-1ca2a979-09bf-4b7a-a6bd-86b0ad16e2e9 tempest-DeleteServersTestJSON-1940532783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.764s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-7f51ab9b-0811-404c-a697-e36cc36f3f28 req-1ca2a979-09bf-4b7a-a6bd-86b0ad16e2e9 tempest-DeleteServersTestJSON-1940532783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e70026c-2d87-447e-bf74-64797be02541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97f0394a-220b-4064-96c4-a74f52b22d44', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ff02fa-1de4-4dbb-9ced-d6cf542e8d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:52 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] Volume volume-97f0394a-220b-4064-96c4-a74f52b22d44 (97f0394a-220b-4064-96c4-a74f52b22d44): created successfully Nov 03 13:06:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ff02fa-1de4-4dbb-9ced-d6cf542e8d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] Flow 'volume_create_manager' (24a24dc6-1b26-4208-8b07-9bc4a07cf857) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:06:52 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-286323fb-109d-4ddb-becd-1b9f12b9106c tempest-ServerRescueNegativeTestJSON-1092638219 None] Created volume successfully. Nov 03 13:06:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-7f51ab9b-0811-404c-a697-e36cc36f3f28 req-1ca2a979-09bf-4b7a-a6bd-86b0ad16e2e9 tempest-DeleteServersTestJSON-1940532783 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43', 'name': 'volume-d06b4b99-e2c7-43a5-bfd0-ba0331fca6b4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '558e38d8-c0b7-456f-88ef-de10055e167b', 'enforce_multipath': True} {{(pid=86725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:06:52 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-7f51ab9b-0811-404c-a697-e36cc36f3f28 req-1ca2a979-09bf-4b7a-a6bd-86b0ad16e2e9 tempest-DeleteServersTestJSON-1940532783 None] attachment_update completed successfully. Nov 03 13:06:52 devstack cinder-volume[86725]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 03 13:06:52 devstack cinder-volume[86725]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 13:06:52 devstack cinder-volume[86725]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 03 13:06:52 devstack cinder-volume[86725]: WARNING oslo.privsep.daemon [-] privsep log: Nov 03 13:06:52 devstack cinder-volume[86725]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 03 13:06:52 devstack cinder-volume[86725]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 03 13:06:52 devstack cinder-volume[86725]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 13:06:52 devstack cinder-volume[86725]: WARNING oslo.privsep.daemon [-] privsep log: Nov 03 13:06:52 devstack cinder-volume[86725]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 03 13:06:53 devstack sudo[88052]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:53 devstack cinder-volume[86725]: INFO oslo.privsep.daemon [None req-4c304590-b1eb-472c-a5eb-81371bec71c1 tempest-VolumesAdminNegativeTest-1679709595 None] Spawned new privsep daemon via rootwrap Nov 03 13:06:53 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [None req-4c304590-b1eb-472c-a5eb-81371bec71c1 tempest-VolumesAdminNegativeTest-1679709595 None] Accepted privsep connection to /tmp/tmp4ngyihbq/privsep.sock {{(pid=86725) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 03 13:06:53 devstack cinder-volume[86725]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 03 13:06:53 devstack cinder-volume[86725]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 03 13:06:53 devstack cinder-volume[86725]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 03 13:06:53 devstack cinder-volume[86725]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88062 Nov 03 13:06:53 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[53301547-a226-4855-bf11-92b45075f308]: (2,) {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:53 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[1622395b-f925-4630-aa6e-3af0ee108a06]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4c304590-b1eb-472c-a5eb-81371bec71c1 tempest-VolumesAdminNegativeTest-1679709595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-eb823302-b544-45c1-892a-fc68919c10c3 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:53 devstack sudo[88065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-eb823302-b544-45c1-892a-fc68919c10c3 Nov 03 13:06:53 devstack sudo[88065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:54 devstack sudo[88065]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4c304590-b1eb-472c-a5eb-81371bec71c1 tempest-VolumesAdminNegativeTest-1679709595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-eb823302-b544-45c1-892a-fc68919c10c3" returned: 0 in 1.369s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4c304590-b1eb-472c-a5eb-81371bec71c1 tempest-VolumesAdminNegativeTest-1679709595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-eb823302-b544-45c1-892a-fc68919c10c3 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:54 devstack sudo[88492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-eb823302-b544-45c1-892a-fc68919c10c3 Nov 03 13:06:54 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:55 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4c304590-b1eb-472c-a5eb-81371bec71c1 tempest-VolumesAdminNegativeTest-1679709595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-eb823302-b544-45c1-892a-fc68919c10c3" returned: 0 in 0.791s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:55 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4c304590-b1eb-472c-a5eb-81371bec71c1 tempest-VolumesAdminNegativeTest-1679709595 None] Lock "cinder-quobyte-eb823302-b544-45c1-892a-fc68919c10c3" released by "delete_volume" :: held 4.861s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:55 devstack cinder-volume[86725]: WARNING cinder.quota [None req-4c304590-b1eb-472c-a5eb-81371bec71c1 tempest-VolumesAdminNegativeTest-1679709595 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:06:55 devstack cinder-volume[86725]: WARNING cinder.quota [None req-4c304590-b1eb-472c-a5eb-81371bec71c1 tempest-VolumesAdminNegativeTest-1679709595 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:06:55 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-4c304590-b1eb-472c-a5eb-81371bec71c1 tempest-VolumesAdminNegativeTest-1679709595 None] Created reservations ['f74d56c5-0a30-4a1d-b800-76b30851b933', 'f2e767f9-d183-4c40-9dcf-61cba05d4f0c', '5e6ac688-95ca-4163-afb4-c26e0f9752b8', '7092dd1f-3558-4123-b859-53625fbbeccf'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:06:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4c304590-b1eb-472c-a5eb-81371bec71c1 tempest-VolumesAdminNegativeTest-1679709595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4c304590-b1eb-472c-a5eb-81371bec71c1 tempest-VolumesAdminNegativeTest-1679709595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:56 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4c304590-b1eb-472c-a5eb-81371bec71c1 tempest-VolumesAdminNegativeTest-1679709595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:06:56 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4c304590-b1eb-472c-a5eb-81371bec71c1 tempest-VolumesAdminNegativeTest-1679709595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:06:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4c304590-b1eb-472c-a5eb-81371bec71c1 tempest-VolumesAdminNegativeTest-1679709595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4c304590-b1eb-472c-a5eb-81371bec71c1 tempest-VolumesAdminNegativeTest-1679709595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:56 devstack sudo[88498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:06:56 devstack sudo[88498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:56 devstack sudo[88498]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4c304590-b1eb-472c-a5eb-81371bec71c1 tempest-VolumesAdminNegativeTest-1679709595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.724s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:56 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-4c304590-b1eb-472c-a5eb-81371bec71c1 tempest-VolumesAdminNegativeTest-1679709595 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:06:56 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-4c304590-b1eb-472c-a5eb-81371bec71c1 tempest-VolumesAdminNegativeTest-1679709595 None] Deleted volume successfully. Nov 03 13:06:56 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4c304590-b1eb-472c-a5eb-81371bec71c1 tempest-VolumesAdminNegativeTest-1679709595 None] Lock "cinder-eb823302-b544-45c1-892a-fc68919c10c3-delete_volume" released by "delete_volume" :: held 6.618s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:58 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:06:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:06:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:06:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:58 devstack sudo[88600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:06:58 devstack sudo[88600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:59 devstack sudo[88600]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.409s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:59 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:06:59 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager._thread_info {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:06:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread count: 8 {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:06:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread info: [<_MainThread(MainThread, started 133507074375808)>, , , , , , , ] {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:07:03 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-f11e80ef-e873-40d4-bab2-16ff0e67518f req-97603e74-cc09-465c-b947-2a0cab426e48 tempest-DeleteServersTestJSON-1940532783 None] Terminate volume connection completed successfully. Nov 03 13:07:03 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-f11e80ef-e873-40d4-bab2-16ff0e67518f req-97603e74-cc09-465c-b947-2a0cab426e48 tempest-DeleteServersTestJSON-1940532783 None] Deleting attachment 558e38d8-c0b7-456f-88ef-de10055e167b. {{(pid=86725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:07:06 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:UPDATE=22,cinder:SELECT=16,cinder:INSERT=3,cinder:DELETE=3 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:07:08 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c00e6638-69f4-4849-b612-af7e8a98c128 tempest-DeleteServersTestJSON-1940532783 None] Acquiring lock "cinder-d06b4b99-e2c7-43a5-bfd0-ba0331fca6b4-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:07:08 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c00e6638-69f4-4849-b612-af7e8a98c128 tempest-DeleteServersTestJSON-1940532783 None] Lock "cinder-d06b4b99-e2c7-43a5-bfd0-ba0331fca6b4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:07:08 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c00e6638-69f4-4849-b612-af7e8a98c128 tempest-DeleteServersTestJSON-1940532783 None] Acquiring lock "cinder-quobyte-d06b4b99-e2c7-43a5-bfd0-ba0331fca6b4" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:07:08 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c00e6638-69f4-4849-b612-af7e8a98c128 tempest-DeleteServersTestJSON-1940532783 None] Lock "cinder-quobyte-d06b4b99-e2c7-43a5-bfd0-ba0331fca6b4" acquired by "delete_volume" :: waited 0.019s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:07:08 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a7f3de-009d-4e94-9c96-bf9aa37b6b32]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:07:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c00e6638-69f4-4849-b612-af7e8a98c128 tempest-DeleteServersTestJSON-1940532783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d06b4b99-e2c7-43a5-bfd0-ba0331fca6b4 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:08 devstack sudo[88644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d06b4b99-e2c7-43a5-bfd0-ba0331fca6b4 Nov 03 13:07:08 devstack sudo[88644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:09 devstack sudo[88644]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c00e6638-69f4-4849-b612-af7e8a98c128 tempest-DeleteServersTestJSON-1940532783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d06b4b99-e2c7-43a5-bfd0-ba0331fca6b4" returned: 0 in 0.400s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c00e6638-69f4-4849-b612-af7e8a98c128 tempest-DeleteServersTestJSON-1940532783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d06b4b99-e2c7-43a5-bfd0-ba0331fca6b4 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:09 devstack sudo[88649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d06b4b99-e2c7-43a5-bfd0-ba0331fca6b4 Nov 03 13:07:09 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:09 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c00e6638-69f4-4849-b612-af7e8a98c128 tempest-DeleteServersTestJSON-1940532783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d06b4b99-e2c7-43a5-bfd0-ba0331fca6b4" returned: 0 in 0.594s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:09 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c00e6638-69f4-4849-b612-af7e8a98c128 tempest-DeleteServersTestJSON-1940532783 None] Lock "cinder-quobyte-d06b4b99-e2c7-43a5-bfd0-ba0331fca6b4" released by "delete_volume" :: held 1.074s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:07:09 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-c00e6638-69f4-4849-b612-af7e8a98c128 tempest-DeleteServersTestJSON-1940532783 None] Created reservations ['ea34fb37-a11b-411b-bc07-245f18011cf6', 'eb4dc369-7de8-441a-ac7e-d432ad5451a4', '39f1edb8-4f11-4110-a0da-a4aa8659793f', 'a02228a7-9d90-4992-89d9-d0780894da0e'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:07:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c00e6638-69f4-4849-b612-af7e8a98c128 tempest-DeleteServersTestJSON-1940532783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:07:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c00e6638-69f4-4849-b612-af7e8a98c128 tempest-DeleteServersTestJSON-1940532783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:07:10 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-c00e6638-69f4-4849-b612-af7e8a98c128 tempest-DeleteServersTestJSON-1940532783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:07:10 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-c00e6638-69f4-4849-b612-af7e8a98c128 tempest-DeleteServersTestJSON-1940532783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:07:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c00e6638-69f4-4849-b612-af7e8a98c128 tempest-DeleteServersTestJSON-1940532783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:07:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c00e6638-69f4-4849-b612-af7e8a98c128 tempest-DeleteServersTestJSON-1940532783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:10 devstack sudo[88652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:07:10 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:10 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c00e6638-69f4-4849-b612-af7e8a98c128 tempest-DeleteServersTestJSON-1940532783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.345s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:10 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-c00e6638-69f4-4849-b612-af7e8a98c128 tempest-DeleteServersTestJSON-1940532783 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:07:10 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-c00e6638-69f4-4849-b612-af7e8a98c128 tempest-DeleteServersTestJSON-1940532783 None] Deleted volume successfully. Nov 03 13:07:10 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c00e6638-69f4-4849-b612-af7e8a98c128 tempest-DeleteServersTestJSON-1940532783 None] Lock "cinder-d06b4b99-e2c7-43a5-bfd0-ba0331fca6b4-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:07:17 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-749925fb-a40b-4cca-9f31-f26745286847 tempest-ServerRescueNegativeTestJSON-1092638219 None] Acquiring lock "cinder-97f0394a-220b-4064-96c4-a74f52b22d44-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:07:17 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-749925fb-a40b-4cca-9f31-f26745286847 tempest-ServerRescueNegativeTestJSON-1092638219 None] Lock "cinder-97f0394a-220b-4064-96c4-a74f52b22d44-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:07:17 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-749925fb-a40b-4cca-9f31-f26745286847 tempest-ServerRescueNegativeTestJSON-1092638219 None] Acquiring lock "cinder-quobyte-97f0394a-220b-4064-96c4-a74f52b22d44" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:07:17 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-749925fb-a40b-4cca-9f31-f26745286847 tempest-ServerRescueNegativeTestJSON-1092638219 None] Lock "cinder-quobyte-97f0394a-220b-4064-96c4-a74f52b22d44" acquired by "delete_volume" :: waited 0.034s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:07:17 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd242c3-22a3-458a-b1b3-ab043e412458]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:07:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-749925fb-a40b-4cca-9f31-f26745286847 tempest-ServerRescueNegativeTestJSON-1092638219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-97f0394a-220b-4064-96c4-a74f52b22d44 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:17 devstack sudo[88690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-97f0394a-220b-4064-96c4-a74f52b22d44 Nov 03 13:07:17 devstack sudo[88690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:18 devstack sudo[88690]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-749925fb-a40b-4cca-9f31-f26745286847 tempest-ServerRescueNegativeTestJSON-1092638219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-97f0394a-220b-4064-96c4-a74f52b22d44" returned: 0 in 0.657s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-749925fb-a40b-4cca-9f31-f26745286847 tempest-ServerRescueNegativeTestJSON-1092638219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-97f0394a-220b-4064-96c4-a74f52b22d44 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:18 devstack sudo[88695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-97f0394a-220b-4064-96c4-a74f52b22d44 Nov 03 13:07:18 devstack sudo[88695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:19 devstack sudo[88695]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-749925fb-a40b-4cca-9f31-f26745286847 tempest-ServerRescueNegativeTestJSON-1092638219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-97f0394a-220b-4064-96c4-a74f52b22d44" returned: 0 in 0.827s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:19 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-749925fb-a40b-4cca-9f31-f26745286847 tempest-ServerRescueNegativeTestJSON-1092638219 None] Lock "cinder-quobyte-97f0394a-220b-4064-96c4-a74f52b22d44" released by "delete_volume" :: held 1.589s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:07:19 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-749925fb-a40b-4cca-9f31-f26745286847 tempest-ServerRescueNegativeTestJSON-1092638219 None] Created reservations ['205fa81f-f3e1-465b-bbbc-106ea048129f', 'e1b10757-8cd6-4f6b-9e73-6445920245bd', 'bf5261be-7ac0-4cbc-a64c-4d342d28759e', 'abd304bd-c194-495a-aa5b-a01c433c2448'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:07:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-749925fb-a40b-4cca-9f31-f26745286847 tempest-ServerRescueNegativeTestJSON-1092638219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:07:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-749925fb-a40b-4cca-9f31-f26745286847 tempest-ServerRescueNegativeTestJSON-1092638219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:07:19 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-749925fb-a40b-4cca-9f31-f26745286847 tempest-ServerRescueNegativeTestJSON-1092638219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:07:19 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-749925fb-a40b-4cca-9f31-f26745286847 tempest-ServerRescueNegativeTestJSON-1092638219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:07:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-749925fb-a40b-4cca-9f31-f26745286847 tempest-ServerRescueNegativeTestJSON-1092638219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:07:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-749925fb-a40b-4cca-9f31-f26745286847 tempest-ServerRescueNegativeTestJSON-1092638219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:19 devstack sudo[88710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:07:19 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:20 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-749925fb-a40b-4cca-9f31-f26745286847 tempest-ServerRescueNegativeTestJSON-1092638219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.636s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:20 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-749925fb-a40b-4cca-9f31-f26745286847 tempest-ServerRescueNegativeTestJSON-1092638219 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:07:20 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-749925fb-a40b-4cca-9f31-f26745286847 tempest-ServerRescueNegativeTestJSON-1092638219 None] Deleted volume successfully. Nov 03 13:07:20 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-749925fb-a40b-4cca-9f31-f26745286847 tempest-ServerRescueNegativeTestJSON-1092638219 None] Lock "cinder-97f0394a-220b-4064-96c4-a74f52b22d44-delete_volume" released by "delete_volume" :: held 2.836s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:07:32 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=32,cinder:UPDATE=29,cinder:INSERT=7,cinder:DELETE=2 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:07:32 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=10,cinder:UPDATE=19,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:07:46 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:07:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] Flow 'volume_create_manager' (6bc9fa7b-71da-4e31-bb69-36af40a3d79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:07:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89651e9a-33de-4c6f-8ac2-cd31c760ef00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89651e9a-33de-4c6f-8ac2-cd31c760ef00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-147596618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f8eaf59-4aa4-4176-b3be-fcda17887286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a26de4b54d747ce9d6d6576122d0fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:07:46Z,use_quota=True,user_id='70a67ed387764da58df81fd4a6b5cdb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce6ed4ef-beae-42b5-875c-101268a6a4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce6ed4ef-beae-42b5-875c-101268a6a4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (117679c3-5b57-4193-af40-a6d585b637f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (117679c3-5b57-4193-af40-a6d585b637f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f8eaf59-4aa4-4176-b3be-fcda17887286', 'volume_name': 'volume-9f8eaf59-4aa4-4176-b3be-fcda17887286', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3139ca9e-8cb7-4f05-b4c3-cf7719d38b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3139ca9e-8cb7-4f05-b4c3-cf7719d38b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d06bd71-79a2-4212-a223-d51fd9077631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:46 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] Volume 9f8eaf59-4aa4-4176-b3be-fcda17887286: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f8eaf59-4aa4-4176-b3be-fcda17887286', 'volume_size': 1} Nov 03 13:07:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:07:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:07:46 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-147596618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f8eaf59-4aa4-4176-b3be-fcda17887286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a26de4b54d747ce9d6d6576122d0fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:07:46Z,use_quota=True,user_id='70a67ed387764da58df81fd4a6b5cdb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:07:46 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] Creating volume 9f8eaf59-4aa4-4176-b3be-fcda17887286 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:07:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:07:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:07:46 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:07:46 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:07:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:07:46 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:07:46 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:07:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:46 devstack sudo[88849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286 1073741824 Nov 03 13:07:46 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:46 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286 1073741824" returned: 0 in 0.639s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:46 devstack sudo[88867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286 Nov 03 13:07:46 devstack sudo[88867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:47 devstack sudo[88867]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286" returned: 0 in 0.283s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:47 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:07:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:07:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d06bd71-79a2-4212-a223-d51fd9077631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f8eaf59-4aa4-4176-b3be-fcda17887286', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14cb0723-1020-4cf6-a79c-4b08f271a621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:47 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] Volume volume-9f8eaf59-4aa4-4176-b3be-fcda17887286 (9f8eaf59-4aa4-4176-b3be-fcda17887286): created successfully Nov 03 13:07:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14cb0723-1020-4cf6-a79c-4b08f271a621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] Flow 'volume_create_manager' (6bc9fa7b-71da-4e31-bb69-36af40a3d79f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:07:47 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-12b81a57-43b3-472b-85a6-fe844c502a39 req-886a7666-16b6-4c6d-8d59-8dc6bd95c6b8 tempest-VolumesSnapshotsTestJSON-1553752808 None] Created volume successfully. Nov 03 13:07:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-50b65126-3b3f-40cf-b535-b779a682a34f req-b1fbad93-3a18-4925-b058-cb59645991f5 tempest-VolumesSnapshotsTestJSON-1553752808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:07:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-50b65126-3b3f-40cf-b535-b779a682a34f req-b1fbad93-3a18-4925-b058-cb59645991f5 tempest-VolumesSnapshotsTestJSON-1553752808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:07:48 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [req-50b65126-3b3f-40cf-b535-b779a682a34f req-b1fbad93-3a18-4925-b058-cb59645991f5 tempest-VolumesSnapshotsTestJSON-1553752808 None] Creating offline snapshot f37242b9-3e08-4f85-98a5-dfd55a4ae4ce of volume 9f8eaf59-4aa4-4176-b3be-fcda17887286 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:07:48 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[98da307b-0360-47cd-9c8b-8d3fec9d3e71]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:07:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-50b65126-3b3f-40cf-b535-b779a682a34f req-b1fbad93-3a18-4925-b058-cb59645991f5 tempest-VolumesSnapshotsTestJSON-1553752808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:48 devstack sudo[88870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286 Nov 03 13:07:48 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:49 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-50b65126-3b3f-40cf-b535-b779a682a34f req-b1fbad93-3a18-4925-b058-cb59645991f5 tempest-VolumesSnapshotsTestJSON-1553752808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286" returned: 0 in 0.462s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-50b65126-3b3f-40cf-b535-b779a682a34f req-b1fbad93-3a18-4925-b058-cb59645991f5 tempest-VolumesSnapshotsTestJSON-1553752808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286.f37242b9-3e08-4f85-98a5-dfd55a4ae4ce 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:49 devstack sudo[88875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286.f37242b9-3e08-4f85-98a5-dfd55a4ae4ce 1G Nov 03 13:07:49 devstack sudo[88875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:49 devstack sudo[88875]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-50b65126-3b3f-40cf-b535-b779a682a34f req-b1fbad93-3a18-4925-b058-cb59645991f5 tempest-VolumesSnapshotsTestJSON-1553752808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286.f37242b9-3e08-4f85-98a5-dfd55a4ae4ce 1G" returned: 0 in 0.488s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-50b65126-3b3f-40cf-b535-b779a682a34f req-b1fbad93-3a18-4925-b058-cb59645991f5 tempest-VolumesSnapshotsTestJSON-1553752808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f8eaf59-4aa4-4176-b3be-fcda17887286 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286.f37242b9-3e08-4f85-98a5-dfd55a4ae4ce {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:49 devstack sudo[88881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f8eaf59-4aa4-4176-b3be-fcda17887286 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286.f37242b9-3e08-4f85-98a5-dfd55a4ae4ce Nov 03 13:07:49 devstack sudo[88881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:50 devstack sudo[88881]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-50b65126-3b3f-40cf-b535-b779a682a34f req-b1fbad93-3a18-4925-b058-cb59645991f5 tempest-VolumesSnapshotsTestJSON-1553752808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f8eaf59-4aa4-4176-b3be-fcda17887286 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286.f37242b9-3e08-4f85-98a5-dfd55a4ae4ce" returned: 0 in 0.375s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:50 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [req-50b65126-3b3f-40cf-b535-b779a682a34f req-b1fbad93-3a18-4925-b058-cb59645991f5 tempest-VolumesSnapshotsTestJSON-1553752808 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286.f37242b9-3e08-4f85-98a5-dfd55a4ae4ce is being set with open permissions: ugo+rw Nov 03 13:07:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-50b65126-3b3f-40cf-b535-b779a682a34f req-b1fbad93-3a18-4925-b058-cb59645991f5 tempest-VolumesSnapshotsTestJSON-1553752808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286.f37242b9-3e08-4f85-98a5-dfd55a4ae4ce {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:50 devstack sudo[88887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286.f37242b9-3e08-4f85-98a5-dfd55a4ae4ce Nov 03 13:07:50 devstack sudo[88887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:50 devstack sudo[88887]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-50b65126-3b3f-40cf-b535-b779a682a34f req-b1fbad93-3a18-4925-b058-cb59645991f5 tempest-VolumesSnapshotsTestJSON-1553752808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286.f37242b9-3e08-4f85-98a5-dfd55a4ae4ce" returned: 0 in 0.293s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-50b65126-3b3f-40cf-b535-b779a682a34f req-b1fbad93-3a18-4925-b058-cb59645991f5 tempest-VolumesSnapshotsTestJSON-1553752808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:50 devstack sudo[88891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286.info Nov 03 13:07:50 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:50 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-50b65126-3b3f-40cf-b535-b779a682a34f req-b1fbad93-3a18-4925-b058-cb59645991f5 tempest-VolumesSnapshotsTestJSON-1553752808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286.info" returned: 0 in 0.311s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:50 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [req-50b65126-3b3f-40cf-b535-b779a682a34f req-b1fbad93-3a18-4925-b058-cb59645991f5 tempest-VolumesSnapshotsTestJSON-1553752808 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286.info is being set with open permissions: ugo+rw Nov 03 13:07:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-50b65126-3b3f-40cf-b535-b779a682a34f req-b1fbad93-3a18-4925-b058-cb59645991f5 tempest-VolumesSnapshotsTestJSON-1553752808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:50 devstack sudo[88894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286.info Nov 03 13:07:50 devstack sudo[88894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:50 devstack sudo[88894]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-50b65126-3b3f-40cf-b535-b779a682a34f req-b1fbad93-3a18-4925-b058-cb59645991f5 tempest-VolumesSnapshotsTestJSON-1553752808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286.info" returned: 0 in 0.280s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-50b65126-3b3f-40cf-b535-b779a682a34f req-b1fbad93-3a18-4925-b058-cb59645991f5 tempest-VolumesSnapshotsTestJSON-1553752808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.354s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:07:51 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-50b65126-3b3f-40cf-b535-b779a682a34f req-b1fbad93-3a18-4925-b058-cb59645991f5 tempest-VolumesSnapshotsTestJSON-1553752808 None] Create snapshot completed successfully Nov 03 13:07:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [req-0b7b3333-1628-4ad0-aa90-7ba49b803f75 req-c37271ab-029a-4892-a64b-fd68c94f95ae tempest-VolumesSnapshotsTestJSON-1553752808 None] Acquiring lock "cinder-f37242b9-3e08-4f85-98a5-dfd55a4ae4ce-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:07:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [req-0b7b3333-1628-4ad0-aa90-7ba49b803f75 req-c37271ab-029a-4892-a64b-fd68c94f95ae tempest-VolumesSnapshotsTestJSON-1553752808 None] Lock "cinder-f37242b9-3e08-4f85-98a5-dfd55a4ae4ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:07:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [req-0b7b3333-1628-4ad0-aa90-7ba49b803f75 req-c37271ab-029a-4892-a64b-fd68c94f95ae tempest-VolumesSnapshotsTestJSON-1553752808 None] Acquiring lock "cinder-quobyte-9f8eaf59-4aa4-4176-b3be-fcda17887286" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:07:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [req-0b7b3333-1628-4ad0-aa90-7ba49b803f75 req-c37271ab-029a-4892-a64b-fd68c94f95ae tempest-VolumesSnapshotsTestJSON-1553752808 None] Lock "cinder-quobyte-9f8eaf59-4aa4-4176-b3be-fcda17887286" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:07:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [req-0b7b3333-1628-4ad0-aa90-7ba49b803f75 req-c37271ab-029a-4892-a64b-fd68c94f95ae tempest-VolumesSnapshotsTestJSON-1553752808 None] Acquiring lock "cinder-quobyte-f37242b9-3e08-4f85-98a5-dfd55a4ae4ce" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:07:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [req-0b7b3333-1628-4ad0-aa90-7ba49b803f75 req-c37271ab-029a-4892-a64b-fd68c94f95ae tempest-VolumesSnapshotsTestJSON-1553752808 None] Lock "cinder-quobyte-f37242b9-3e08-4f85-98a5-dfd55a4ae4ce" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:07:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [req-0b7b3333-1628-4ad0-aa90-7ba49b803f75 req-c37271ab-029a-4892-a64b-fd68c94f95ae tempest-VolumesSnapshotsTestJSON-1553752808 None] Deleting offline snapshot f37242b9-3e08-4f85-98a5-dfd55a4ae4ce of volume 9f8eaf59-4aa4-4176-b3be-fcda17887286 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:07:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [req-0b7b3333-1628-4ad0-aa90-7ba49b803f75 req-c37271ab-029a-4892-a64b-fd68c94f95ae tempest-VolumesSnapshotsTestJSON-1553752808 None] snapshot_file for this snap is: volume-9f8eaf59-4aa4-4176-b3be-fcda17887286.f37242b9-3e08-4f85-98a5-dfd55a4ae4ce {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:07:51 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[0356cd11-f56b-4f31-bc77-504313473424]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:07:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-0b7b3333-1628-4ad0-aa90-7ba49b803f75 req-c37271ab-029a-4892-a64b-fd68c94f95ae tempest-VolumesSnapshotsTestJSON-1553752808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286.f37242b9-3e08-4f85-98a5-dfd55a4ae4ce {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:51 devstack sudo[88897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286.f37242b9-3e08-4f85-98a5-dfd55a4ae4ce Nov 03 13:07:51 devstack sudo[88897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:51 devstack sudo[88897]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-0b7b3333-1628-4ad0-aa90-7ba49b803f75 req-c37271ab-029a-4892-a64b-fd68c94f95ae tempest-VolumesSnapshotsTestJSON-1553752808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286.f37242b9-3e08-4f85-98a5-dfd55a4ae4ce" returned: 0 in 0.525s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [req-0b7b3333-1628-4ad0-aa90-7ba49b803f75 req-c37271ab-029a-4892-a64b-fd68c94f95ae tempest-VolumesSnapshotsTestJSON-1553752808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f8eaf59-4aa4-4176-b3be-fcda17887286(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:07:51 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[753a62c1-122e-4d0a-8c76-51b70061bf2d]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:07:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-0b7b3333-1628-4ad0-aa90-7ba49b803f75 req-c37271ab-029a-4892-a64b-fd68c94f95ae tempest-VolumesSnapshotsTestJSON-1553752808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:52 devstack sudo[88902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286 Nov 03 13:07:52 devstack sudo[88902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:52 devstack sudo[88902]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-0b7b3333-1628-4ad0-aa90-7ba49b803f75 req-c37271ab-029a-4892-a64b-fd68c94f95ae tempest-VolumesSnapshotsTestJSON-1553752808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286" returned: 0 in 0.476s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-0b7b3333-1628-4ad0-aa90-7ba49b803f75 req-c37271ab-029a-4892-a64b-fd68c94f95ae tempest-VolumesSnapshotsTestJSON-1553752808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286.f37242b9-3e08-4f85-98a5-dfd55a4ae4ce {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:52 devstack sudo[88907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286.f37242b9-3e08-4f85-98a5-dfd55a4ae4ce Nov 03 13:07:52 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:52 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-0b7b3333-1628-4ad0-aa90-7ba49b803f75 req-c37271ab-029a-4892-a64b-fd68c94f95ae tempest-VolumesSnapshotsTestJSON-1553752808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286.f37242b9-3e08-4f85-98a5-dfd55a4ae4ce" returned: 0 in 0.440s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-0b7b3333-1628-4ad0-aa90-7ba49b803f75 req-c37271ab-029a-4892-a64b-fd68c94f95ae tempest-VolumesSnapshotsTestJSON-1553752808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286.f37242b9-3e08-4f85-98a5-dfd55a4ae4ce {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:52 devstack sudo[88913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286.f37242b9-3e08-4f85-98a5-dfd55a4ae4ce Nov 03 13:07:52 devstack sudo[88913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:53 devstack sudo[88913]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-0b7b3333-1628-4ad0-aa90-7ba49b803f75 req-c37271ab-029a-4892-a64b-fd68c94f95ae tempest-VolumesSnapshotsTestJSON-1553752808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286.f37242b9-3e08-4f85-98a5-dfd55a4ae4ce" returned: 0 in 0.257s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [req-0b7b3333-1628-4ad0-aa90-7ba49b803f75 req-c37271ab-029a-4892-a64b-fd68c94f95ae tempest-VolumesSnapshotsTestJSON-1553752808 None] Lock "cinder-quobyte-f37242b9-3e08-4f85-98a5-dfd55a4ae4ce" released by "_delete_snapshot" :: held 1.861s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:07:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [req-0b7b3333-1628-4ad0-aa90-7ba49b803f75 req-c37271ab-029a-4892-a64b-fd68c94f95ae tempest-VolumesSnapshotsTestJSON-1553752808 None] Lock "cinder-quobyte-9f8eaf59-4aa4-4176-b3be-fcda17887286" released by "delete_snapshot" :: held 1.897s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:07:53 devstack cinder-volume[86725]: WARNING cinder.quota [req-0b7b3333-1628-4ad0-aa90-7ba49b803f75 req-c37271ab-029a-4892-a64b-fd68c94f95ae tempest-VolumesSnapshotsTestJSON-1553752808 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:07:53 devstack cinder-volume[86725]: DEBUG cinder.quota [req-0b7b3333-1628-4ad0-aa90-7ba49b803f75 req-c37271ab-029a-4892-a64b-fd68c94f95ae tempest-VolumesSnapshotsTestJSON-1553752808 None] Created reservations ['ff90779f-5001-4a51-837e-1c6dc9a37f22', '3480f7b7-ac4e-48b9-8fe1-000efc7381aa', '8f49cc69-c505-4bf1-8414-337e4e48876a', 'c3c91d89-9d0b-4149-9d5b-9700363e88fb'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:07:53 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-0b7b3333-1628-4ad0-aa90-7ba49b803f75 req-c37271ab-029a-4892-a64b-fd68c94f95ae tempest-VolumesSnapshotsTestJSON-1553752808 None] Delete snapshot completed successfully. Nov 03 13:07:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [req-0b7b3333-1628-4ad0-aa90-7ba49b803f75 req-c37271ab-029a-4892-a64b-fd68c94f95ae tempest-VolumesSnapshotsTestJSON-1553752808 None] Lock "cinder-f37242b9-3e08-4f85-98a5-dfd55a4ae4ce-delete_snapshot" released by "delete_snapshot" :: held 2.097s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:07:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [req-64ebb0a2-ed44-4a9f-9fbb-e01c1ad79100 req-d10654aa-1c7a-4a80-9480-3cdfbf4225f9 tempest-VolumesSnapshotsTestJSON-1553752808 None] Acquiring lock "cinder-9f8eaf59-4aa4-4176-b3be-fcda17887286-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:07:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [req-64ebb0a2-ed44-4a9f-9fbb-e01c1ad79100 req-d10654aa-1c7a-4a80-9480-3cdfbf4225f9 tempest-VolumesSnapshotsTestJSON-1553752808 None] Lock "cinder-9f8eaf59-4aa4-4176-b3be-fcda17887286-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:07:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [req-64ebb0a2-ed44-4a9f-9fbb-e01c1ad79100 req-d10654aa-1c7a-4a80-9480-3cdfbf4225f9 tempest-VolumesSnapshotsTestJSON-1553752808 None] Acquiring lock "cinder-quobyte-9f8eaf59-4aa4-4176-b3be-fcda17887286" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:07:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [req-64ebb0a2-ed44-4a9f-9fbb-e01c1ad79100 req-d10654aa-1c7a-4a80-9480-3cdfbf4225f9 tempest-VolumesSnapshotsTestJSON-1553752808 None] Lock "cinder-quobyte-9f8eaf59-4aa4-4176-b3be-fcda17887286" acquired by "delete_volume" :: waited 0.022s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:07:53 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa93669f-780a-4041-b535-993d079cd333]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:07:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-64ebb0a2-ed44-4a9f-9fbb-e01c1ad79100 req-d10654aa-1c7a-4a80-9480-3cdfbf4225f9 tempest-VolumesSnapshotsTestJSON-1553752808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:53 devstack sudo[88916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286 Nov 03 13:07:53 devstack sudo[88916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:54 devstack sudo[88916]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-64ebb0a2-ed44-4a9f-9fbb-e01c1ad79100 req-d10654aa-1c7a-4a80-9480-3cdfbf4225f9 tempest-VolumesSnapshotsTestJSON-1553752808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286" returned: 0 in 0.467s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-64ebb0a2-ed44-4a9f-9fbb-e01c1ad79100 req-d10654aa-1c7a-4a80-9480-3cdfbf4225f9 tempest-VolumesSnapshotsTestJSON-1553752808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:54 devstack sudo[88924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286 Nov 03 13:07:54 devstack sudo[88924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:54 devstack sudo[88924]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-64ebb0a2-ed44-4a9f-9fbb-e01c1ad79100 req-d10654aa-1c7a-4a80-9480-3cdfbf4225f9 tempest-VolumesSnapshotsTestJSON-1553752808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f8eaf59-4aa4-4176-b3be-fcda17887286" returned: 0 in 0.324s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:54 devstack cinder-volume[86725]: DEBUG cinder.coordination [req-64ebb0a2-ed44-4a9f-9fbb-e01c1ad79100 req-d10654aa-1c7a-4a80-9480-3cdfbf4225f9 tempest-VolumesSnapshotsTestJSON-1553752808 None] Lock "cinder-quobyte-9f8eaf59-4aa4-4176-b3be-fcda17887286" released by "delete_volume" :: held 0.879s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:07:54 devstack cinder-volume[86725]: DEBUG cinder.quota [req-64ebb0a2-ed44-4a9f-9fbb-e01c1ad79100 req-d10654aa-1c7a-4a80-9480-3cdfbf4225f9 tempest-VolumesSnapshotsTestJSON-1553752808 None] Created reservations ['42dcd583-6ce7-4a35-9641-3f4dfe08d633', 'f7c3c9a9-699b-40bd-b931-c30d19b2e350', '8e6ab59a-e987-4fa8-9adc-b0d44ea1f16b', '68f8af5b-864a-46a0-a8a7-4407806b9d4e'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:07:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-64ebb0a2-ed44-4a9f-9fbb-e01c1ad79100 req-d10654aa-1c7a-4a80-9480-3cdfbf4225f9 tempest-VolumesSnapshotsTestJSON-1553752808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:07:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-64ebb0a2-ed44-4a9f-9fbb-e01c1ad79100 req-d10654aa-1c7a-4a80-9480-3cdfbf4225f9 tempest-VolumesSnapshotsTestJSON-1553752808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:07:54 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [req-64ebb0a2-ed44-4a9f-9fbb-e01c1ad79100 req-d10654aa-1c7a-4a80-9480-3cdfbf4225f9 tempest-VolumesSnapshotsTestJSON-1553752808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:07:54 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [req-64ebb0a2-ed44-4a9f-9fbb-e01c1ad79100 req-d10654aa-1c7a-4a80-9480-3cdfbf4225f9 tempest-VolumesSnapshotsTestJSON-1553752808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:07:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-64ebb0a2-ed44-4a9f-9fbb-e01c1ad79100 req-d10654aa-1c7a-4a80-9480-3cdfbf4225f9 tempest-VolumesSnapshotsTestJSON-1553752808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:07:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-64ebb0a2-ed44-4a9f-9fbb-e01c1ad79100 req-d10654aa-1c7a-4a80-9480-3cdfbf4225f9 tempest-VolumesSnapshotsTestJSON-1553752808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:54 devstack sudo[88933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:07:54 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:55 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-64ebb0a2-ed44-4a9f-9fbb-e01c1ad79100 req-d10654aa-1c7a-4a80-9480-3cdfbf4225f9 tempest-VolumesSnapshotsTestJSON-1553752808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.314s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:55 devstack cinder-volume[86725]: DEBUG cinder.manager [req-64ebb0a2-ed44-4a9f-9fbb-e01c1ad79100 req-d10654aa-1c7a-4a80-9480-3cdfbf4225f9 tempest-VolumesSnapshotsTestJSON-1553752808 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:07:55 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-64ebb0a2-ed44-4a9f-9fbb-e01c1ad79100 req-d10654aa-1c7a-4a80-9480-3cdfbf4225f9 tempest-VolumesSnapshotsTestJSON-1553752808 None] Deleted volume successfully. Nov 03 13:07:55 devstack cinder-volume[86725]: DEBUG cinder.coordination [req-64ebb0a2-ed44-4a9f-9fbb-e01c1ad79100 req-d10654aa-1c7a-4a80-9480-3cdfbf4225f9 tempest-VolumesSnapshotsTestJSON-1553752808 None] Lock "cinder-9f8eaf59-4aa4-4176-b3be-fcda17887286-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:07:58 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:07:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:07:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:07:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:07:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:07:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:07:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:58 devstack sudo[88937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:07:58 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:59 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.601s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:59 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:07:59 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:07:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] Flow 'volume_create_manager' (e60b9394-2c09-4392-84e7-3a1e10eed25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:07:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3707f55-b6c7-43e6-9f6a-3a99e1f367a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3707f55-b6c7-43e6-9f6a-3a99e1f367a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-378985209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff0bbcb-640f-4806-88f7-32af1ce1fe8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fed0ff10f9344a1b8b558f7dc7601597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:07:59Z,use_quota=True,user_id='031997203f0849e5b19733094d6f359f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90953673-23e0-42c1-acc3-e199e130dff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90953673-23e0-42c1-acc3-e199e130dff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72546094-f4cd-4535-853f-e305fdceaed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72546094-f4cd-4535-853f-e305fdceaed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ff0bbcb-640f-4806-88f7-32af1ce1fe8f', 'volume_name': 'volume-5ff0bbcb-640f-4806-88f7-32af1ce1fe8f', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8930659-b89d-4a40-b072-a4d0be2fe878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8930659-b89d-4a40-b072-a4d0be2fe878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a9a29e-640d-4e77-b0e6-2cafaec8497e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:59 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] Volume 5ff0bbcb-640f-4806-88f7-32af1ce1fe8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ff0bbcb-640f-4806-88f7-32af1ce1fe8f', 'volume_size': 1} Nov 03 13:07:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:07:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:07:59 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-378985209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff0bbcb-640f-4806-88f7-32af1ce1fe8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fed0ff10f9344a1b8b558f7dc7601597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:07:59Z,use_quota=True,user_id='031997203f0849e5b19733094d6f359f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:07:59 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] Creating volume 5ff0bbcb-640f-4806-88f7-32af1ce1fe8f {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:07:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:07:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:07:59 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:07:59 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:07:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:07:59 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:07:59 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:07:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5ff0bbcb-640f-4806-88f7-32af1ce1fe8f 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:59 devstack sudo[88984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5ff0bbcb-640f-4806-88f7-32af1ce1fe8f 1073741824 Nov 03 13:07:59 devstack sudo[88984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:00 devstack sudo[88984]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5ff0bbcb-640f-4806-88f7-32af1ce1fe8f 1073741824" returned: 0 in 0.786s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5ff0bbcb-640f-4806-88f7-32af1ce1fe8f {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:00 devstack sudo[89014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5ff0bbcb-640f-4806-88f7-32af1ce1fe8f Nov 03 13:08:00 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:01 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5ff0bbcb-640f-4806-88f7-32af1ce1fe8f" returned: 0 in 0.464s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:01 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:08:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:08:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a9a29e-640d-4e77-b0e6-2cafaec8497e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ff0bbcb-640f-4806-88f7-32af1ce1fe8f', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f949a419-8452-4dc7-bf7b-f99e5b01abd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:01 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] Volume volume-5ff0bbcb-640f-4806-88f7-32af1ce1fe8f (5ff0bbcb-640f-4806-88f7-32af1ce1fe8f): created successfully Nov 03 13:08:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f949a419-8452-4dc7-bf7b-f99e5b01abd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] Flow 'volume_create_manager' (e60b9394-2c09-4392-84e7-3a1e10eed25c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:08:01 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-00b3f15c-08c4-4962-8bbc-1e5a12bc8ce4 tempest-TaggedAttachmentsTest-987816765 None] Created volume successfully. Nov 03 13:08:04 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:08:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Flow 'volume_create_manager' (90519dbd-e9b0-4833-b72e-5dbe40610397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:08:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b282aba-694b-4f3d-a127-6b11d6220830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b282aba-694b-4f3d-a127-6b11d6220830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1375204173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a14ca7c-9fb5-4b56-92b5-cbdf34163218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d035814199c4044ac33392811cc9f07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:08:05Z,use_quota=True,user_id='bbcaf46250cc4f80a27524605a925ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc0b6bc9-e67a-46ae-9464-92dcd8bd72f2),volume_type_id=fc0b6bc9-e67a-46ae-9464-92dcd8bd72f2)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (993f364d-f066-48be-97b4-abc4a1e0d79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (993f364d-f066-48be-97b4-abc4a1e0d79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be2d5117-c589-412b-9d22-9393e47ed452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be2d5117-c589-412b-9d22-9393e47ed452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a14ca7c-9fb5-4b56-92b5-cbdf34163218', 'volume_name': 'volume-4a14ca7c-9fb5-4b56-92b5-cbdf34163218', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a17122d9-10ac-4247-8855-676b6951619f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a17122d9-10ac-4247-8855-676b6951619f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32543770-44ae-4f5d-b19e-d6eab9420c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:04 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Volume 4a14ca7c-9fb5-4b56-92b5-cbdf34163218: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a14ca7c-9fb5-4b56-92b5-cbdf34163218', 'volume_size': 1} Nov 03 13:08:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:08:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:08:04 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1375204173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a14ca7c-9fb5-4b56-92b5-cbdf34163218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d035814199c4044ac33392811cc9f07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:08:05Z,use_quota=True,user_id='bbcaf46250cc4f80a27524605a925ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc0b6bc9-e67a-46ae-9464-92dcd8bd72f2),volume_type_id=fc0b6bc9-e67a-46ae-9464-92dcd8bd72f2)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:08:04 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Creating volume 4a14ca7c-9fb5-4b56-92b5-cbdf34163218 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:08:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:08:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:08:04 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:08:04 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:08:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:08:04 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:08:04 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:08:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4a14ca7c-9fb5-4b56-92b5-cbdf34163218 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:04 devstack sudo[89043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4a14ca7c-9fb5-4b56-92b5-cbdf34163218 1073741824 Nov 03 13:08:04 devstack sudo[89043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:05 devstack sudo[89043]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4a14ca7c-9fb5-4b56-92b5-cbdf34163218 1073741824" returned: 0 in 0.569s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4a14ca7c-9fb5-4b56-92b5-cbdf34163218 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:05 devstack sudo[89052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4a14ca7c-9fb5-4b56-92b5-cbdf34163218 Nov 03 13:08:05 devstack sudo[89052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:05 devstack sudo[89052]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4a14ca7c-9fb5-4b56-92b5-cbdf34163218" returned: 0 in 0.495s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:05 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:08:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:08:05 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32543770-44ae-4f5d-b19e-d6eab9420c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a14ca7c-9fb5-4b56-92b5-cbdf34163218', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:05 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (285d3a55-d0b4-4a38-be3b-ba932dcc215c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:05 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Volume volume-4a14ca7c-9fb5-4b56-92b5-cbdf34163218 (4a14ca7c-9fb5-4b56-92b5-cbdf34163218): created successfully Nov 03 13:08:05 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (285d3a55-d0b4-4a38-be3b-ba932dcc215c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:05 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Flow 'volume_create_manager' (90519dbd-e9b0-4833-b72e-5dbe40610397) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:08:05 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-eb0d21c5-66e0-416a-bc72-c2e1cb43d7fd tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Created volume successfully. Nov 03 13:08:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-819c2b70-06be-460f-9f28-ea35f71c8067 tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:08:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-819c2b70-06be-460f-9f28-ea35f71c8067 tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:08:07 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-819c2b70-06be-460f-9f28-ea35f71c8067 tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:08:07 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-819c2b70-06be-460f-9f28-ea35f71c8067 tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:08:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-819c2b70-06be-460f-9f28-ea35f71c8067 tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:08:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-819c2b70-06be-460f-9f28-ea35f71c8067 tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:07 devstack sudo[89116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:08:07 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:08 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-819c2b70-06be-460f-9f28-ea35f71c8067 tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.591s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:08 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-819c2b70-06be-460f-9f28-ea35f71c8067 tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:08:08 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-819c2b70-06be-460f-9f28-ea35f71c8067 tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Retype volume completed successfully. Nov 03 13:08:09 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9791fdb1-68a5-4f06-8da2-3a494d134ed7 tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Acquiring lock "cinder-4a14ca7c-9fb5-4b56-92b5-cbdf34163218-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:08:09 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9791fdb1-68a5-4f06-8da2-3a494d134ed7 tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Lock "cinder-4a14ca7c-9fb5-4b56-92b5-cbdf34163218-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:08:09 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9791fdb1-68a5-4f06-8da2-3a494d134ed7 tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Acquiring lock "cinder-quobyte-4a14ca7c-9fb5-4b56-92b5-cbdf34163218" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:08:09 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9791fdb1-68a5-4f06-8da2-3a494d134ed7 tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Lock "cinder-quobyte-4a14ca7c-9fb5-4b56-92b5-cbdf34163218" acquired by "delete_volume" :: waited 0.025s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:08:09 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[f427ff28-a7e1-4753-93bf-cef6f0c7f74b]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:08:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9791fdb1-68a5-4f06-8da2-3a494d134ed7 tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4a14ca7c-9fb5-4b56-92b5-cbdf34163218 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:10 devstack sudo[89132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4a14ca7c-9fb5-4b56-92b5-cbdf34163218 Nov 03 13:08:10 devstack sudo[89132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:10 devstack sudo[89132]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9791fdb1-68a5-4f06-8da2-3a494d134ed7 tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4a14ca7c-9fb5-4b56-92b5-cbdf34163218" returned: 0 in 0.536s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9791fdb1-68a5-4f06-8da2-3a494d134ed7 tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4a14ca7c-9fb5-4b56-92b5-cbdf34163218 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:10 devstack sudo[89137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4a14ca7c-9fb5-4b56-92b5-cbdf34163218 Nov 03 13:08:10 devstack sudo[89137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:10 devstack sudo[89137]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9791fdb1-68a5-4f06-8da2-3a494d134ed7 tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4a14ca7c-9fb5-4b56-92b5-cbdf34163218" returned: 0 in 0.305s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:10 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9791fdb1-68a5-4f06-8da2-3a494d134ed7 tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Lock "cinder-quobyte-4a14ca7c-9fb5-4b56-92b5-cbdf34163218" released by "delete_volume" :: held 0.943s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:08:10 devstack cinder-volume[86725]: WARNING cinder.quota [None req-9791fdb1-68a5-4f06-8da2-3a494d134ed7 tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:08:10 devstack cinder-volume[86725]: WARNING cinder.quota [None req-9791fdb1-68a5-4f06-8da2-3a494d134ed7 tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:08:10 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-9791fdb1-68a5-4f06-8da2-3a494d134ed7 tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Created reservations ['880f6156-ca90-44a3-b356-e31490798121', 'c7628a8b-8e5c-4082-a872-c031c720d229', '2197f57f-7bbe-460a-8a12-fcc508df30b6', 'd0d51fc7-7707-4442-93a5-ca183212d6ac'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:08:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9791fdb1-68a5-4f06-8da2-3a494d134ed7 tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:08:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9791fdb1-68a5-4f06-8da2-3a494d134ed7 tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:08:11 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-9791fdb1-68a5-4f06-8da2-3a494d134ed7 tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:08:11 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-9791fdb1-68a5-4f06-8da2-3a494d134ed7 tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:08:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9791fdb1-68a5-4f06-8da2-3a494d134ed7 tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:08:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9791fdb1-68a5-4f06-8da2-3a494d134ed7 tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:11 devstack sudo[89143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:08:11 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:11 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9791fdb1-68a5-4f06-8da2-3a494d134ed7 tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.690s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:11 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-9791fdb1-68a5-4f06-8da2-3a494d134ed7 tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:08:11 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-9791fdb1-68a5-4f06-8da2-3a494d134ed7 tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Deleted volume successfully. Nov 03 13:08:11 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9791fdb1-68a5-4f06-8da2-3a494d134ed7 tempest-VolumeRetypeWithoutMigrationTest-1505402931 None] Lock "cinder-4a14ca7c-9fb5-4b56-92b5-cbdf34163218-delete_volume" released by "delete_volume" :: held 2.081s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:08:21 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=38,cinder:UPDATE=34,cinder:DELETE=4,cinder:INSERT=5 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:08:21 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=26,cinder:UPDATE=39,cinder:INSERT=11,cinder:DELETE=2 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:08:26 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:08:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] Flow 'volume_create_manager' (3cd2ad49-2a54-4087-947a-d0d3c8754fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:08:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e302e03-0da3-4a8c-b695-d643a52b478d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e302e03-0da3-4a8c-b695-d643a52b478d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2000538655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aada1f55-1d1a-49ce-b8ed-9a1b34d9e74f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c06621f542c499ab0b94a2623f03850',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:08:27Z,use_quota=True,user_id='75aedde209454b70b36a89b2259f54b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c470735c-efc1-4b91-8783-3c2cc2bb5716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c470735c-efc1-4b91-8783-3c2cc2bb5716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d00ec53-2e45-4d53-96fe-7812292c2a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d00ec53-2e45-4d53-96fe-7812292c2a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aada1f55-1d1a-49ce-b8ed-9a1b34d9e74f', 'volume_name': 'volume-aada1f55-1d1a-49ce-b8ed-9a1b34d9e74f', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (344d0648-93df-416a-8353-2a179b287e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (344d0648-93df-416a-8353-2a179b287e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d0980b-2cbb-4cc2-9eae-fbc259dd9d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:26 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] Volume aada1f55-1d1a-49ce-b8ed-9a1b34d9e74f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aada1f55-1d1a-49ce-b8ed-9a1b34d9e74f', 'volume_size': 1} Nov 03 13:08:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:08:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:08:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2000538655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aada1f55-1d1a-49ce-b8ed-9a1b34d9e74f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c06621f542c499ab0b94a2623f03850',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:08:27Z,use_quota=True,user_id='75aedde209454b70b36a89b2259f54b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:08:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] Creating volume aada1f55-1d1a-49ce-b8ed-9a1b34d9e74f {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:08:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:08:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:08:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:08:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:08:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:08:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:08:26 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:08:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aada1f55-1d1a-49ce-b8ed-9a1b34d9e74f 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:27 devstack sudo[89423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aada1f55-1d1a-49ce-b8ed-9a1b34d9e74f 1073741824 Nov 03 13:08:27 devstack sudo[89423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:27 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:08:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] Flow 'volume_create_manager' (3a1e5add-f3a2-4f6b-ac6f-f02e56e7d992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:08:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4e4eae0-39b6-4775-b6df-1e8d3280ca46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4e4eae0-39b6-4775-b6df-1e8d3280ca46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-195028929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e0206bf-9b6b-4e5d-9b1d-d4cf5006f4ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fd0fdd100df4dbba98b85a6138a572d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:08:27Z,use_quota=True,user_id='ae904f32be2843d6a9c9945038a450c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a4e2ac-394f-41ca-b981-34bcd3a93309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a4e2ac-394f-41ca-b981-34bcd3a93309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9df370c-df58-4235-be74-ab4f16802d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9df370c-df58-4235-be74-ab4f16802d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e0206bf-9b6b-4e5d-9b1d-d4cf5006f4ba', 'volume_name': 'volume-9e0206bf-9b6b-4e5d-9b1d-d4cf5006f4ba', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58fc5d25-f71c-422f-b270-8e5e72af78fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58fc5d25-f71c-422f-b270-8e5e72af78fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c4b00fd-5149-4936-bb6b-ae7f50d071b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:27 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] Volume 9e0206bf-9b6b-4e5d-9b1d-d4cf5006f4ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e0206bf-9b6b-4e5d-9b1d-d4cf5006f4ba', 'volume_size': 1} Nov 03 13:08:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:08:27 devstack sudo[89423]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aada1f55-1d1a-49ce-b8ed-9a1b34d9e74f 1073741824" returned: 0 in 0.821s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aada1f55-1d1a-49ce-b8ed-9a1b34d9e74f {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:27 devstack sudo[89431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aada1f55-1d1a-49ce-b8ed-9a1b34d9e74f Nov 03 13:08:27 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:28 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aada1f55-1d1a-49ce-b8ed-9a1b34d9e74f" returned: 0 in 0.404s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:28 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:08:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:08:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.985s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:08:28 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-195028929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e0206bf-9b6b-4e5d-9b1d-d4cf5006f4ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fd0fdd100df4dbba98b85a6138a572d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:08:27Z,use_quota=True,user_id='ae904f32be2843d6a9c9945038a450c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:08:28 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] Creating volume 9e0206bf-9b6b-4e5d-9b1d-d4cf5006f4ba {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:08:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:08:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:08:28 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:08:28 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:08:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:08:28 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:08:28 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:08:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9e0206bf-9b6b-4e5d-9b1d-d4cf5006f4ba 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d0980b-2cbb-4cc2-9eae-fbc259dd9d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aada1f55-1d1a-49ce-b8ed-9a1b34d9e74f', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:28 devstack sudo[89437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9e0206bf-9b6b-4e5d-9b1d-d4cf5006f4ba 1073741824 Nov 03 13:08:28 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6300cc93-766b-42e9-86e4-2449cb666244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:28 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] Volume volume-aada1f55-1d1a-49ce-b8ed-9a1b34d9e74f (aada1f55-1d1a-49ce-b8ed-9a1b34d9e74f): created successfully Nov 03 13:08:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6300cc93-766b-42e9-86e4-2449cb666244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] Flow 'volume_create_manager' (3cd2ad49-2a54-4087-947a-d0d3c8754fce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:08:28 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-8df612b1-0da1-460a-a6b4-293ec8819684 tempest-AttachVolumeTestJSON-2041145724 None] Created volume successfully. Nov 03 13:08:28 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9e0206bf-9b6b-4e5d-9b1d-d4cf5006f4ba 1073741824" returned: 0 in 0.647s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9e0206bf-9b6b-4e5d-9b1d-d4cf5006f4ba {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:28 devstack sudo[89450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9e0206bf-9b6b-4e5d-9b1d-d4cf5006f4ba Nov 03 13:08:28 devstack sudo[89450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:29 devstack sudo[89450]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9e0206bf-9b6b-4e5d-9b1d-d4cf5006f4ba" returned: 0 in 0.331s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:29 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:08:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:08:29 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c4b00fd-5149-4936-bb6b-ae7f50d071b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e0206bf-9b6b-4e5d-9b1d-d4cf5006f4ba', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:29 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc5200f-2b91-46a9-8c64-aec933a55849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:29 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] Volume volume-9e0206bf-9b6b-4e5d-9b1d-d4cf5006f4ba (9e0206bf-9b6b-4e5d-9b1d-d4cf5006f4ba): created successfully Nov 03 13:08:29 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc5200f-2b91-46a9-8c64-aec933a55849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:29 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] Flow 'volume_create_manager' (3a1e5add-f3a2-4f6b-ac6f-f02e56e7d992) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:08:29 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-cdeebad5-88a4-49b8-bc64-08c1e38d79bb tempest-VolumesServicesTestJSON-1146905712 None] Created volume successfully. Nov 03 13:08:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-557fdbb3-3c56-4b62-aa25-083ef48765a2 req-2c2f9bb4-0dab-4b7a-9433-2fbbef85fbcb tempest-AttachVolumeTestJSON-2041145724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:08:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-557fdbb3-3c56-4b62-aa25-083ef48765a2 req-2c2f9bb4-0dab-4b7a-9433-2fbbef85fbcb tempest-AttachVolumeTestJSON-2041145724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:08:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-557fdbb3-3c56-4b62-aa25-083ef48765a2 req-2c2f9bb4-0dab-4b7a-9433-2fbbef85fbcb tempest-AttachVolumeTestJSON-2041145724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:08:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-557fdbb3-3c56-4b62-aa25-083ef48765a2 req-2c2f9bb4-0dab-4b7a-9433-2fbbef85fbcb tempest-AttachVolumeTestJSON-2041145724 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43', 'name': 'volume-aada1f55-1d1a-49ce-b8ed-9a1b34d9e74f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cbc16996-46a7-4a6e-ada4-ded4c9a9166a', 'enforce_multipath': True} {{(pid=86725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:08:30 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:08:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] Flow 'volume_create_manager' (f6e61cba-346c-4344-b8f5-6ce642860c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:08:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9243fa22-2d31-4a95-b56f-dad5050ef89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:30 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-557fdbb3-3c56-4b62-aa25-083ef48765a2 req-2c2f9bb4-0dab-4b7a-9433-2fbbef85fbcb tempest-AttachVolumeTestJSON-2041145724 None] attachment_update completed successfully. Nov 03 13:08:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9243fa22-2d31-4a95-b56f-dad5050ef89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-819707436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e028d8bd-0633-431b-8361-d9eccdc44806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7fe7fff3c0d4f9295b5037ebf2d0612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:08:30Z,use_quota=True,user_id='d64c4543de2740bba763d369b7ed4c7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c3095e-6fd2-44f7-86e7-df6ae9d60a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c3095e-6fd2-44f7-86e7-df6ae9d60a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9758567e-e0e0-4229-9fb1-b7b742c1cc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9758567e-e0e0-4229-9fb1-b7b742c1cc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e028d8bd-0633-431b-8361-d9eccdc44806', 'volume_name': 'volume-e028d8bd-0633-431b-8361-d9eccdc44806', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f87e17-8e45-4570-ad26-828c5cb1536d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f87e17-8e45-4570-ad26-828c5cb1536d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a67755-c326-4c81-83fa-062a18b92f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:30 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] Volume e028d8bd-0633-431b-8361-d9eccdc44806: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e028d8bd-0633-431b-8361-d9eccdc44806', 'volume_size': 1} Nov 03 13:08:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:08:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:08:30 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-819707436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e028d8bd-0633-431b-8361-d9eccdc44806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7fe7fff3c0d4f9295b5037ebf2d0612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:08:30Z,use_quota=True,user_id='d64c4543de2740bba763d369b7ed4c7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:08:30 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] Creating volume e028d8bd-0633-431b-8361-d9eccdc44806 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:08:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:08:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:08:30 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:08:30 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:08:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:08:30 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:08:30 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:08:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e028d8bd-0633-431b-8361-d9eccdc44806 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:30 devstack sudo[89463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e028d8bd-0633-431b-8361-d9eccdc44806 1073741824 Nov 03 13:08:30 devstack sudo[89463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:30 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5d99941d-ee27-4c61-bfe7-57b6577eceb4 tempest-VolumesServicesTestJSON-1146905712 None] Acquiring lock "cinder-9e0206bf-9b6b-4e5d-9b1d-d4cf5006f4ba-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:08:30 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5d99941d-ee27-4c61-bfe7-57b6577eceb4 tempest-VolumesServicesTestJSON-1146905712 None] Lock "cinder-9e0206bf-9b6b-4e5d-9b1d-d4cf5006f4ba-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:08:31 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5d99941d-ee27-4c61-bfe7-57b6577eceb4 tempest-VolumesServicesTestJSON-1146905712 None] Acquiring lock "cinder-quobyte-9e0206bf-9b6b-4e5d-9b1d-d4cf5006f4ba" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:08:31 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5d99941d-ee27-4c61-bfe7-57b6577eceb4 tempest-VolumesServicesTestJSON-1146905712 None] Lock "cinder-quobyte-9e0206bf-9b6b-4e5d-9b1d-d4cf5006f4ba" acquired by "delete_volume" :: waited 0.031s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:08:31 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ee7908-e2b8-4c1c-b7a6-7878cd4a1394]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:08:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5d99941d-ee27-4c61-bfe7-57b6577eceb4 tempest-VolumesServicesTestJSON-1146905712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9e0206bf-9b6b-4e5d-9b1d-d4cf5006f4ba {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:31 devstack sudo[89883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9e0206bf-9b6b-4e5d-9b1d-d4cf5006f4ba Nov 03 13:08:31 devstack sudo[89883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:31 devstack sudo[89463]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e028d8bd-0633-431b-8361-d9eccdc44806 1073741824" returned: 0 in 0.947s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e028d8bd-0633-431b-8361-d9eccdc44806 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:31 devstack sudo[89885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e028d8bd-0633-431b-8361-d9eccdc44806 Nov 03 13:08:31 devstack sudo[89885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:31 devstack sudo[89883]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5d99941d-ee27-4c61-bfe7-57b6577eceb4 tempest-VolumesServicesTestJSON-1146905712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9e0206bf-9b6b-4e5d-9b1d-d4cf5006f4ba" returned: 0 in 0.549s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5d99941d-ee27-4c61-bfe7-57b6577eceb4 tempest-VolumesServicesTestJSON-1146905712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9e0206bf-9b6b-4e5d-9b1d-d4cf5006f4ba {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:31 devstack sudo[89890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9e0206bf-9b6b-4e5d-9b1d-d4cf5006f4ba Nov 03 13:08:31 devstack sudo[89890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:31 devstack sudo[89885]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e028d8bd-0633-431b-8361-d9eccdc44806" returned: 0 in 0.436s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:31 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:08:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:08:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a67755-c326-4c81-83fa-062a18b92f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e028d8bd-0633-431b-8361-d9eccdc44806', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98944e94-2014-4340-b65e-5396acffd3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:32 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] Volume volume-e028d8bd-0633-431b-8361-d9eccdc44806 (e028d8bd-0633-431b-8361-d9eccdc44806): created successfully Nov 03 13:08:32 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98944e94-2014-4340-b65e-5396acffd3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:32 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] Flow 'volume_create_manager' (f6e61cba-346c-4344-b8f5-6ce642860c3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:08:32 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-2deb6e8d-fead-454e-aedb-4327f2ab1864 tempest-ServersNegativeTestJSON-400892815 None] Created volume successfully. Nov 03 13:08:32 devstack sudo[89890]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5d99941d-ee27-4c61-bfe7-57b6577eceb4 tempest-VolumesServicesTestJSON-1146905712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9e0206bf-9b6b-4e5d-9b1d-d4cf5006f4ba" returned: 0 in 0.410s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:32 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5d99941d-ee27-4c61-bfe7-57b6577eceb4 tempest-VolumesServicesTestJSON-1146905712 None] Lock "cinder-quobyte-9e0206bf-9b6b-4e5d-9b1d-d4cf5006f4ba" released by "delete_volume" :: held 1.036s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:08:32 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-5d99941d-ee27-4c61-bfe7-57b6577eceb4 tempest-VolumesServicesTestJSON-1146905712 None] Created reservations ['ce2aa550-c69c-46ae-a4b8-449d7aefafce', 'b2581a37-8345-42e6-901b-5e0b545f0124', 'a649e09c-f89d-4c0d-aec2-dda137a881f9', '0105ef38-fcb6-4559-84e9-498cdad5b4f7'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:08:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5d99941d-ee27-4c61-bfe7-57b6577eceb4 tempest-VolumesServicesTestJSON-1146905712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:08:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5d99941d-ee27-4c61-bfe7-57b6577eceb4 tempest-VolumesServicesTestJSON-1146905712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:08:32 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5d99941d-ee27-4c61-bfe7-57b6577eceb4 tempest-VolumesServicesTestJSON-1146905712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:08:32 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5d99941d-ee27-4c61-bfe7-57b6577eceb4 tempest-VolumesServicesTestJSON-1146905712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:08:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5d99941d-ee27-4c61-bfe7-57b6577eceb4 tempest-VolumesServicesTestJSON-1146905712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:08:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5d99941d-ee27-4c61-bfe7-57b6577eceb4 tempest-VolumesServicesTestJSON-1146905712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:32 devstack sudo[89894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:08:32 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:32 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5d99941d-ee27-4c61-bfe7-57b6577eceb4 tempest-VolumesServicesTestJSON-1146905712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.388s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:32 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-5d99941d-ee27-4c61-bfe7-57b6577eceb4 tempest-VolumesServicesTestJSON-1146905712 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:08:32 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-5d99941d-ee27-4c61-bfe7-57b6577eceb4 tempest-VolumesServicesTestJSON-1146905712 None] Deleted volume successfully. Nov 03 13:08:32 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5d99941d-ee27-4c61-bfe7-57b6577eceb4 tempest-VolumesServicesTestJSON-1146905712 None] Lock "cinder-9e0206bf-9b6b-4e5d-9b1d-d4cf5006f4ba-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:08:34 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:08:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] Flow 'volume_create_manager' (5b09e842-527a-4085-ada2-e51b7ac3d994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:08:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (327e3d2a-691c-4ec6-a689-0dd1ec24b2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (327e3d2a-691c-4ec6-a689-0dd1ec24b2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-407514988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=160b58ce-6a3c-4d15-8f03-df697ee7097d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7fe7fff3c0d4f9295b5037ebf2d0612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:08:34Z,use_quota=True,user_id='d64c4543de2740bba763d369b7ed4c7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beec94fe-c562-408b-b4e2-2b7a38d4f5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beec94fe-c562-408b-b4e2-2b7a38d4f5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff12f5bd-64b3-4db2-8773-f167475bf706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff12f5bd-64b3-4db2-8773-f167475bf706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '160b58ce-6a3c-4d15-8f03-df697ee7097d', 'volume_name': 'volume-160b58ce-6a3c-4d15-8f03-df697ee7097d', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f840de26-0572-4cd1-b304-ed6768a94fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f840de26-0572-4cd1-b304-ed6768a94fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bef1476-298f-4254-bb7f-7e43a9f9223d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:34 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] Volume 160b58ce-6a3c-4d15-8f03-df697ee7097d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-160b58ce-6a3c-4d15-8f03-df697ee7097d', 'volume_size': 1} Nov 03 13:08:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:08:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:08:34 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-407514988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=160b58ce-6a3c-4d15-8f03-df697ee7097d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7fe7fff3c0d4f9295b5037ebf2d0612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:08:34Z,use_quota=True,user_id='d64c4543de2740bba763d369b7ed4c7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:08:34 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] Creating volume 160b58ce-6a3c-4d15-8f03-df697ee7097d {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:08:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:08:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:08:34 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:08:34 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:08:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:08:34 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:08:34 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:08:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-160b58ce-6a3c-4d15-8f03-df697ee7097d 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:34 devstack sudo[89903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-160b58ce-6a3c-4d15-8f03-df697ee7097d 1073741824 Nov 03 13:08:34 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:35 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-160b58ce-6a3c-4d15-8f03-df697ee7097d 1073741824" returned: 0 in 0.705s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-160b58ce-6a3c-4d15-8f03-df697ee7097d {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:35 devstack sudo[89910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-160b58ce-6a3c-4d15-8f03-df697ee7097d Nov 03 13:08:35 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:35 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-160b58ce-6a3c-4d15-8f03-df697ee7097d" returned: 0 in 0.412s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:35 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:08:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:08:35 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bef1476-298f-4254-bb7f-7e43a9f9223d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-160b58ce-6a3c-4d15-8f03-df697ee7097d', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:35 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b24bf2e-c9c7-4604-ae7b-0c8a58243224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:35 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] Volume volume-160b58ce-6a3c-4d15-8f03-df697ee7097d (160b58ce-6a3c-4d15-8f03-df697ee7097d): created successfully Nov 03 13:08:35 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b24bf2e-c9c7-4604-ae7b-0c8a58243224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:35 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] Flow 'volume_create_manager' (5b09e842-527a-4085-ada2-e51b7ac3d994) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:08:35 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-23286f29-313b-4d98-841f-280ad46ab83d tempest-ServersNegativeTestJSON-400892815 None] Created volume successfully. Nov 03 13:08:37 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1f36f9f9-832d-4a16-9df9-e54d70bc0dfd tempest-ServersNegativeTestJSON-400892815 None] Acquiring lock "cinder-160b58ce-6a3c-4d15-8f03-df697ee7097d-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:08:37 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1f36f9f9-832d-4a16-9df9-e54d70bc0dfd tempest-ServersNegativeTestJSON-400892815 None] Lock "cinder-160b58ce-6a3c-4d15-8f03-df697ee7097d-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:08:37 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1f36f9f9-832d-4a16-9df9-e54d70bc0dfd tempest-ServersNegativeTestJSON-400892815 None] Acquiring lock "cinder-quobyte-160b58ce-6a3c-4d15-8f03-df697ee7097d" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:08:37 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1f36f9f9-832d-4a16-9df9-e54d70bc0dfd tempest-ServersNegativeTestJSON-400892815 None] Lock "cinder-quobyte-160b58ce-6a3c-4d15-8f03-df697ee7097d" acquired by "delete_volume" :: waited 0.046s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:08:37 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[5618ac09-1100-4bed-94aa-a980408a2212]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:08:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1f36f9f9-832d-4a16-9df9-e54d70bc0dfd tempest-ServersNegativeTestJSON-400892815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-160b58ce-6a3c-4d15-8f03-df697ee7097d {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:37 devstack sudo[90070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-160b58ce-6a3c-4d15-8f03-df697ee7097d Nov 03 13:08:37 devstack sudo[90070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:38 devstack sudo[90070]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1f36f9f9-832d-4a16-9df9-e54d70bc0dfd tempest-ServersNegativeTestJSON-400892815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-160b58ce-6a3c-4d15-8f03-df697ee7097d" returned: 0 in 0.915s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1f36f9f9-832d-4a16-9df9-e54d70bc0dfd tempest-ServersNegativeTestJSON-400892815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-160b58ce-6a3c-4d15-8f03-df697ee7097d {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:38 devstack sudo[90455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-160b58ce-6a3c-4d15-8f03-df697ee7097d Nov 03 13:08:38 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:39 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1f36f9f9-832d-4a16-9df9-e54d70bc0dfd tempest-ServersNegativeTestJSON-400892815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-160b58ce-6a3c-4d15-8f03-df697ee7097d" returned: 0 in 0.654s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:39 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1f36f9f9-832d-4a16-9df9-e54d70bc0dfd tempest-ServersNegativeTestJSON-400892815 None] Lock "cinder-quobyte-160b58ce-6a3c-4d15-8f03-df697ee7097d" released by "delete_volume" :: held 1.644s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:08:39 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-1f36f9f9-832d-4a16-9df9-e54d70bc0dfd tempest-ServersNegativeTestJSON-400892815 None] Created reservations ['6f3d0281-0eff-45d6-8259-d1bbbc132cab', 'c88219cf-2425-46a4-9842-3955e6a36882', 'fc8170a3-12bb-41fb-b9aa-39ef37a05261', '45ad35c8-a4ad-4894-a2dc-4b18fe561298'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:08:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1f36f9f9-832d-4a16-9df9-e54d70bc0dfd tempest-ServersNegativeTestJSON-400892815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:08:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1f36f9f9-832d-4a16-9df9-e54d70bc0dfd tempest-ServersNegativeTestJSON-400892815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:08:39 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1f36f9f9-832d-4a16-9df9-e54d70bc0dfd tempest-ServersNegativeTestJSON-400892815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:08:39 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1f36f9f9-832d-4a16-9df9-e54d70bc0dfd tempest-ServersNegativeTestJSON-400892815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:08:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1f36f9f9-832d-4a16-9df9-e54d70bc0dfd tempest-ServersNegativeTestJSON-400892815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:08:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1f36f9f9-832d-4a16-9df9-e54d70bc0dfd tempest-ServersNegativeTestJSON-400892815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:39 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:08:39 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:39 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5257a877-2acb-4339-9df3-beeba765866a tempest-ServersNegativeTestJSON-400892815 None] Acquiring lock "cinder-e028d8bd-0633-431b-8361-d9eccdc44806-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:08:39 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5257a877-2acb-4339-9df3-beeba765866a tempest-ServersNegativeTestJSON-400892815 None] Lock "cinder-e028d8bd-0633-431b-8361-d9eccdc44806-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:08:39 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5257a877-2acb-4339-9df3-beeba765866a tempest-ServersNegativeTestJSON-400892815 None] Acquiring lock "cinder-quobyte-e028d8bd-0633-431b-8361-d9eccdc44806" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:08:39 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5257a877-2acb-4339-9df3-beeba765866a tempest-ServersNegativeTestJSON-400892815 None] Lock "cinder-quobyte-e028d8bd-0633-431b-8361-d9eccdc44806" acquired by "delete_volume" :: waited 0.018s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:08:39 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[3199e742-036c-47f7-92cd-17ccc2e3185e]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:08:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5257a877-2acb-4339-9df3-beeba765866a tempest-ServersNegativeTestJSON-400892815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e028d8bd-0633-431b-8361-d9eccdc44806 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:39 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1f36f9f9-832d-4a16-9df9-e54d70bc0dfd tempest-ServersNegativeTestJSON-400892815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.422s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:39 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-1f36f9f9-832d-4a16-9df9-e54d70bc0dfd tempest-ServersNegativeTestJSON-400892815 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:08:39 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-1f36f9f9-832d-4a16-9df9-e54d70bc0dfd tempest-ServersNegativeTestJSON-400892815 None] Deleted volume successfully. Nov 03 13:08:39 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1f36f9f9-832d-4a16-9df9-e54d70bc0dfd tempest-ServersNegativeTestJSON-400892815 None] Lock "cinder-160b58ce-6a3c-4d15-8f03-df697ee7097d-delete_volume" released by "delete_volume" :: held 2.538s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:08:39 devstack sudo[90523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e028d8bd-0633-431b-8361-d9eccdc44806 Nov 03 13:08:39 devstack sudo[90523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:40 devstack sudo[90523]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5257a877-2acb-4339-9df3-beeba765866a tempest-ServersNegativeTestJSON-400892815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e028d8bd-0633-431b-8361-d9eccdc44806" returned: 0 in 0.464s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5257a877-2acb-4339-9df3-beeba765866a tempest-ServersNegativeTestJSON-400892815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e028d8bd-0633-431b-8361-d9eccdc44806 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:40 devstack sudo[90530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e028d8bd-0633-431b-8361-d9eccdc44806 Nov 03 13:08:40 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:40 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5257a877-2acb-4339-9df3-beeba765866a tempest-ServersNegativeTestJSON-400892815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e028d8bd-0633-431b-8361-d9eccdc44806" returned: 0 in 0.312s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:40 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5257a877-2acb-4339-9df3-beeba765866a tempest-ServersNegativeTestJSON-400892815 None] Lock "cinder-quobyte-e028d8bd-0633-431b-8361-d9eccdc44806" released by "delete_volume" :: held 0.835s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:08:40 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-5257a877-2acb-4339-9df3-beeba765866a tempest-ServersNegativeTestJSON-400892815 None] Created reservations ['74860629-acd7-4ad7-b7bf-bf4ec8aa39a4', '18880430-0b6f-4753-8e43-9b90ea1169ed', '3f3ecd07-1b5a-46c5-b5f3-0c7608bab8e3', '1b71e637-2cab-414d-8028-a2b99cfc902a'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:08:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5257a877-2acb-4339-9df3-beeba765866a tempest-ServersNegativeTestJSON-400892815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:08:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5257a877-2acb-4339-9df3-beeba765866a tempest-ServersNegativeTestJSON-400892815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:08:40 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5257a877-2acb-4339-9df3-beeba765866a tempest-ServersNegativeTestJSON-400892815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:08:40 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5257a877-2acb-4339-9df3-beeba765866a tempest-ServersNegativeTestJSON-400892815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:08:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5257a877-2acb-4339-9df3-beeba765866a tempest-ServersNegativeTestJSON-400892815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:08:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5257a877-2acb-4339-9df3-beeba765866a tempest-ServersNegativeTestJSON-400892815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:40 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:08:40 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:41 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5257a877-2acb-4339-9df3-beeba765866a tempest-ServersNegativeTestJSON-400892815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.457s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:41 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-5257a877-2acb-4339-9df3-beeba765866a tempest-ServersNegativeTestJSON-400892815 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:08:41 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-5257a877-2acb-4339-9df3-beeba765866a tempest-ServersNegativeTestJSON-400892815 None] Deleted volume successfully. Nov 03 13:08:41 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5257a877-2acb-4339-9df3-beeba765866a tempest-ServersNegativeTestJSON-400892815 None] Lock "cinder-e028d8bd-0633-431b-8361-d9eccdc44806-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:08:49 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:08:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] Flow 'volume_create_manager' (cbdd2f61-2bcb-433c-940f-a47c4313ba78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:08:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46db7a01-8275-4785-8124-99b7ea1d9f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46db7a01-8275-4785-8124-99b7ea1d9f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-432635347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d43cff40-7bc2-452f-ab73-7bd6460961d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3f3f16463c4a958c8810d770e93017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:08:50Z,use_quota=True,user_id='9d44088ab577412aa988d495d3ee9bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e6a460-cb83-4402-9ff1-54c9439bb7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e6a460-cb83-4402-9ff1-54c9439bb7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d555ee3e-def1-4d75-904b-c932174b55e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d555ee3e-def1-4d75-904b-c932174b55e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd43cff40-7bc2-452f-ab73-7bd6460961d0', 'volume_name': 'volume-d43cff40-7bc2-452f-ab73-7bd6460961d0', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9d2205c-43be-43be-88db-574c05d41f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9d2205c-43be-43be-88db-574c05d41f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (281dd9b0-3724-43e5-a102-7b9d92be099b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:50 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] Volume d43cff40-7bc2-452f-ab73-7bd6460961d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d43cff40-7bc2-452f-ab73-7bd6460961d0', 'volume_size': 1} Nov 03 13:08:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:08:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:08:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-432635347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d43cff40-7bc2-452f-ab73-7bd6460961d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3f3f16463c4a958c8810d770e93017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:08:50Z,use_quota=True,user_id='9d44088ab577412aa988d495d3ee9bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:08:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] Creating volume d43cff40-7bc2-452f-ab73-7bd6460961d0 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:08:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:08:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:08:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:08:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:08:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:08:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:08:50 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:08:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:50 devstack sudo[90568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0 1073741824 Nov 03 13:08:50 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:50 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0 1073741824" returned: 0 in 0.631s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:50 devstack sudo[90574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0 Nov 03 13:08:50 devstack sudo[90574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:51 devstack sudo[90574]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0" returned: 0 in 0.369s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:08:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:08:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (281dd9b0-3724-43e5-a102-7b9d92be099b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d43cff40-7bc2-452f-ab73-7bd6460961d0', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56de8f7f-5de5-430b-8ded-75bcf9878da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:51 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] Volume volume-d43cff40-7bc2-452f-ab73-7bd6460961d0 (d43cff40-7bc2-452f-ab73-7bd6460961d0): created successfully Nov 03 13:08:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56de8f7f-5de5-430b-8ded-75bcf9878da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] Flow 'volume_create_manager' (cbdd2f61-2bcb-433c-940f-a47c4313ba78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:08:51 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-3f010b58-7be1-406e-a861-becfece27392 tempest-SnapshotMetadataTestJSON-1502463189 None] Created volume successfully. Nov 03 13:08:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-66599bb9-141d-41ff-8326-8f326659df42 tempest-SnapshotMetadataTestJSON-1502463189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:08:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-66599bb9-141d-41ff-8326-8f326659df42 tempest-SnapshotMetadataTestJSON-1502463189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:08:52 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-66599bb9-141d-41ff-8326-8f326659df42 tempest-SnapshotMetadataTestJSON-1502463189 None] Creating offline snapshot ed7d7bc0-31c1-46af-957b-d93e744dbd4e of volume d43cff40-7bc2-452f-ab73-7bd6460961d0 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:08:52 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7c36f7-3c04-47c4-8ff0-6fd8b0491163]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:08:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-66599bb9-141d-41ff-8326-8f326659df42 tempest-SnapshotMetadataTestJSON-1502463189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:52 devstack sudo[90579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0 Nov 03 13:08:52 devstack sudo[90579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:53 devstack sudo[90579]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-66599bb9-141d-41ff-8326-8f326659df42 tempest-SnapshotMetadataTestJSON-1502463189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0" returned: 0 in 0.862s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-66599bb9-141d-41ff-8326-8f326659df42 tempest-SnapshotMetadataTestJSON-1502463189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0.ed7d7bc0-31c1-46af-957b-d93e744dbd4e 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:53 devstack sudo[90608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0.ed7d7bc0-31c1-46af-957b-d93e744dbd4e 1G Nov 03 13:08:53 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:54 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-66599bb9-141d-41ff-8326-8f326659df42 tempest-SnapshotMetadataTestJSON-1502463189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0.ed7d7bc0-31c1-46af-957b-d93e744dbd4e 1G" returned: 0 in 0.834s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-66599bb9-141d-41ff-8326-8f326659df42 tempest-SnapshotMetadataTestJSON-1502463189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d43cff40-7bc2-452f-ab73-7bd6460961d0 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0.ed7d7bc0-31c1-46af-957b-d93e744dbd4e {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:54 devstack sudo[90644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d43cff40-7bc2-452f-ab73-7bd6460961d0 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0.ed7d7bc0-31c1-46af-957b-d93e744dbd4e Nov 03 13:08:54 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:54 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-66599bb9-141d-41ff-8326-8f326659df42 tempest-SnapshotMetadataTestJSON-1502463189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d43cff40-7bc2-452f-ab73-7bd6460961d0 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0.ed7d7bc0-31c1-46af-957b-d93e744dbd4e" returned: 0 in 0.485s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:54 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-66599bb9-141d-41ff-8326-8f326659df42 tempest-SnapshotMetadataTestJSON-1502463189 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0.ed7d7bc0-31c1-46af-957b-d93e744dbd4e is being set with open permissions: ugo+rw Nov 03 13:08:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-66599bb9-141d-41ff-8326-8f326659df42 tempest-SnapshotMetadataTestJSON-1502463189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0.ed7d7bc0-31c1-46af-957b-d93e744dbd4e {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:54 devstack sudo[90664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0.ed7d7bc0-31c1-46af-957b-d93e744dbd4e Nov 03 13:08:54 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:55 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-66599bb9-141d-41ff-8326-8f326659df42 tempest-SnapshotMetadataTestJSON-1502463189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0.ed7d7bc0-31c1-46af-957b-d93e744dbd4e" returned: 0 in 0.326s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-66599bb9-141d-41ff-8326-8f326659df42 tempest-SnapshotMetadataTestJSON-1502463189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:55 devstack sudo[90667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0.info Nov 03 13:08:55 devstack sudo[90667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:55 devstack sudo[90667]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-66599bb9-141d-41ff-8326-8f326659df42 tempest-SnapshotMetadataTestJSON-1502463189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0.info" returned: 0 in 0.326s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:55 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-66599bb9-141d-41ff-8326-8f326659df42 tempest-SnapshotMetadataTestJSON-1502463189 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0.info is being set with open permissions: ugo+rw Nov 03 13:08:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-66599bb9-141d-41ff-8326-8f326659df42 tempest-SnapshotMetadataTestJSON-1502463189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:55 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0.info Nov 03 13:08:55 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-a8ff2a05-e030-4ecc-9eaa-931d608f0e6c req-2bc5d1c5-4d96-4091-9055-f08ee270f7f0 tempest-TaggedAttachmentsTest-987816765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:08:55 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-66599bb9-141d-41ff-8326-8f326659df42 tempest-SnapshotMetadataTestJSON-1502463189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0.info" returned: 0 in 0.366s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-66599bb9-141d-41ff-8326-8f326659df42 tempest-SnapshotMetadataTestJSON-1502463189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.358s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:08:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-a8ff2a05-e030-4ecc-9eaa-931d608f0e6c req-2bc5d1c5-4d96-4091-9055-f08ee270f7f0 tempest-TaggedAttachmentsTest-987816765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.069s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:08:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-a8ff2a05-e030-4ecc-9eaa-931d608f0e6c req-2bc5d1c5-4d96-4091-9055-f08ee270f7f0 tempest-TaggedAttachmentsTest-987816765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:08:55 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-66599bb9-141d-41ff-8326-8f326659df42 tempest-SnapshotMetadataTestJSON-1502463189 None] Create snapshot completed successfully Nov 03 13:08:55 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-a8ff2a05-e030-4ecc-9eaa-931d608f0e6c req-2bc5d1c5-4d96-4091-9055-f08ee270f7f0 tempest-TaggedAttachmentsTest-987816765 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43', 'name': 'volume-5ff0bbcb-640f-4806-88f7-32af1ce1fe8f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c02f0168-501b-46af-8d7a-4881f3cf4569', 'enforce_multipath': True} {{(pid=86725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:08:55 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-a8ff2a05-e030-4ecc-9eaa-931d608f0e6c req-2bc5d1c5-4d96-4091-9055-f08ee270f7f0 tempest-TaggedAttachmentsTest-987816765 None] attachment_update completed successfully. Nov 03 13:08:57 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-301166ca-c6f4-4cb2-8ef0-643682f5beb4 tempest-SnapshotMetadataTestJSON-1502463189 None] Acquiring lock "cinder-ed7d7bc0-31c1-46af-957b-d93e744dbd4e-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:08:57 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-301166ca-c6f4-4cb2-8ef0-643682f5beb4 tempest-SnapshotMetadataTestJSON-1502463189 None] Lock "cinder-ed7d7bc0-31c1-46af-957b-d93e744dbd4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:08:57 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-301166ca-c6f4-4cb2-8ef0-643682f5beb4 tempest-SnapshotMetadataTestJSON-1502463189 None] Acquiring lock "cinder-quobyte-d43cff40-7bc2-452f-ab73-7bd6460961d0" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:08:58 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-301166ca-c6f4-4cb2-8ef0-643682f5beb4 tempest-SnapshotMetadataTestJSON-1502463189 None] Lock "cinder-quobyte-d43cff40-7bc2-452f-ab73-7bd6460961d0" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:08:58 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-301166ca-c6f4-4cb2-8ef0-643682f5beb4 tempest-SnapshotMetadataTestJSON-1502463189 None] Acquiring lock "cinder-quobyte-ed7d7bc0-31c1-46af-957b-d93e744dbd4e" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:08:58 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-301166ca-c6f4-4cb2-8ef0-643682f5beb4 tempest-SnapshotMetadataTestJSON-1502463189 None] Lock "cinder-quobyte-ed7d7bc0-31c1-46af-957b-d93e744dbd4e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:08:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-301166ca-c6f4-4cb2-8ef0-643682f5beb4 tempest-SnapshotMetadataTestJSON-1502463189 None] Deleting offline snapshot ed7d7bc0-31c1-46af-957b-d93e744dbd4e of volume d43cff40-7bc2-452f-ab73-7bd6460961d0 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:08:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-301166ca-c6f4-4cb2-8ef0-643682f5beb4 tempest-SnapshotMetadataTestJSON-1502463189 None] snapshot_file for this snap is: volume-d43cff40-7bc2-452f-ab73-7bd6460961d0.ed7d7bc0-31c1-46af-957b-d93e744dbd4e {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:08:58 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab06095-40cc-46dd-8d73-5b997f6c22f4]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:08:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-301166ca-c6f4-4cb2-8ef0-643682f5beb4 tempest-SnapshotMetadataTestJSON-1502463189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0.ed7d7bc0-31c1-46af-957b-d93e744dbd4e {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:58 devstack sudo[90715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0.ed7d7bc0-31c1-46af-957b-d93e744dbd4e Nov 03 13:08:58 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:58 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-301166ca-c6f4-4cb2-8ef0-643682f5beb4 tempest-SnapshotMetadataTestJSON-1502463189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0.ed7d7bc0-31c1-46af-957b-d93e744dbd4e" returned: 0 in 0.585s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-301166ca-c6f4-4cb2-8ef0-643682f5beb4 tempest-SnapshotMetadataTestJSON-1502463189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d43cff40-7bc2-452f-ab73-7bd6460961d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:08:58 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:08:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:08:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:08:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:08:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:08:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:08:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:58 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcaeafe3-5cc0-4692-8905-eee365c78ccb]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:08:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-301166ca-c6f4-4cb2-8ef0-643682f5beb4 tempest-SnapshotMetadataTestJSON-1502463189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:58 devstack sudo[90722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:08:58 devstack sudo[90722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:58 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0 Nov 03 13:08:58 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:59 devstack sudo[90722]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.439s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:59 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:08:59 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager._thread_info {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:08:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread count: 8 {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:08:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread info: [<_MainThread(MainThread, started 133507074375808)>, , , , , , , ] {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:08:59 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-301166ca-c6f4-4cb2-8ef0-643682f5beb4 tempest-SnapshotMetadataTestJSON-1502463189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0" returned: 0 in 0.459s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-301166ca-c6f4-4cb2-8ef0-643682f5beb4 tempest-SnapshotMetadataTestJSON-1502463189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0.ed7d7bc0-31c1-46af-957b-d93e744dbd4e {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:59 devstack sudo[90731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0.ed7d7bc0-31c1-46af-957b-d93e744dbd4e Nov 03 13:08:59 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:59 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-873b9a6b-888f-4d38-9816-dba4ba8d3d1e req-7161560e-873f-432f-a1b5-6851f6b818a2 tempest-TaggedAttachmentsTest-987816765 None] Terminate volume connection completed successfully. Nov 03 13:08:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-873b9a6b-888f-4d38-9816-dba4ba8d3d1e req-7161560e-873f-432f-a1b5-6851f6b818a2 tempest-TaggedAttachmentsTest-987816765 None] Deleting attachment c02f0168-501b-46af-8d7a-4881f3cf4569. {{(pid=86725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:08:59 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-301166ca-c6f4-4cb2-8ef0-643682f5beb4 tempest-SnapshotMetadataTestJSON-1502463189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0.ed7d7bc0-31c1-46af-957b-d93e744dbd4e" returned: 0 in 0.412s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-301166ca-c6f4-4cb2-8ef0-643682f5beb4 tempest-SnapshotMetadataTestJSON-1502463189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0.ed7d7bc0-31c1-46af-957b-d93e744dbd4e {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:59 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0.ed7d7bc0-31c1-46af-957b-d93e744dbd4e Nov 03 13:08:59 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:59 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-301166ca-c6f4-4cb2-8ef0-643682f5beb4 tempest-SnapshotMetadataTestJSON-1502463189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0.ed7d7bc0-31c1-46af-957b-d93e744dbd4e" returned: 0 in 0.256s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:59 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-301166ca-c6f4-4cb2-8ef0-643682f5beb4 tempest-SnapshotMetadataTestJSON-1502463189 None] Lock "cinder-quobyte-ed7d7bc0-31c1-46af-957b-d93e744dbd4e" released by "_delete_snapshot" :: held 1.941s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:08:59 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-301166ca-c6f4-4cb2-8ef0-643682f5beb4 tempest-SnapshotMetadataTestJSON-1502463189 None] Lock "cinder-quobyte-d43cff40-7bc2-452f-ab73-7bd6460961d0" released by "delete_snapshot" :: held 1.972s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:00 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-301166ca-c6f4-4cb2-8ef0-643682f5beb4 tempest-SnapshotMetadataTestJSON-1502463189 None] Created reservations ['7c4f262c-6bc6-47ab-b0ad-933850550ea1', '0de4fef0-f29b-4393-859a-9a5bc4e20d49', '206ac99b-84d8-4641-ba60-d39f2ce8c093', '7477e2ef-b098-42fb-afec-d4fbebda5801'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:09:00 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-301166ca-c6f4-4cb2-8ef0-643682f5beb4 tempest-SnapshotMetadataTestJSON-1502463189 None] Delete snapshot completed successfully. Nov 03 13:09:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-301166ca-c6f4-4cb2-8ef0-643682f5beb4 tempest-SnapshotMetadataTestJSON-1502463189 None] Lock "cinder-ed7d7bc0-31c1-46af-957b-d93e744dbd4e-delete_snapshot" released by "delete_snapshot" :: held 2.198s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-eea88dfe-1265-44d5-8edd-3a9511b63df0 tempest-SnapshotMetadataTestJSON-1502463189 None] Acquiring lock "cinder-d43cff40-7bc2-452f-ab73-7bd6460961d0-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-eea88dfe-1265-44d5-8edd-3a9511b63df0 tempest-SnapshotMetadataTestJSON-1502463189 None] Lock "cinder-d43cff40-7bc2-452f-ab73-7bd6460961d0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-eea88dfe-1265-44d5-8edd-3a9511b63df0 tempest-SnapshotMetadataTestJSON-1502463189 None] Acquiring lock "cinder-quobyte-d43cff40-7bc2-452f-ab73-7bd6460961d0" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-eea88dfe-1265-44d5-8edd-3a9511b63df0 tempest-SnapshotMetadataTestJSON-1502463189 None] Lock "cinder-quobyte-d43cff40-7bc2-452f-ab73-7bd6460961d0" acquired by "delete_volume" :: waited 0.021s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:01 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[7270f4ed-dfbf-4ea5-aa6e-f589d962ccaf]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-eea88dfe-1265-44d5-8edd-3a9511b63df0 tempest-SnapshotMetadataTestJSON-1502463189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:01 devstack sudo[90760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0 Nov 03 13:09:01 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:01 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-eea88dfe-1265-44d5-8edd-3a9511b63df0 tempest-SnapshotMetadataTestJSON-1502463189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0" returned: 0 in 0.371s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-eea88dfe-1265-44d5-8edd-3a9511b63df0 tempest-SnapshotMetadataTestJSON-1502463189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:01 devstack sudo[90766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0 Nov 03 13:09:01 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:02 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-eea88dfe-1265-44d5-8edd-3a9511b63df0 tempest-SnapshotMetadataTestJSON-1502463189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d43cff40-7bc2-452f-ab73-7bd6460961d0" returned: 0 in 0.297s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-eea88dfe-1265-44d5-8edd-3a9511b63df0 tempest-SnapshotMetadataTestJSON-1502463189 None] Lock "cinder-quobyte-d43cff40-7bc2-452f-ab73-7bd6460961d0" released by "delete_volume" :: held 0.760s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:02 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-eea88dfe-1265-44d5-8edd-3a9511b63df0 tempest-SnapshotMetadataTestJSON-1502463189 None] Created reservations ['78c26b9b-a910-40cd-bc3b-49ccc5adcaa3', 'dc9e5fc0-7370-4bb7-95d6-9b75809e7bdb', 'af72e9b3-8834-4364-a4e5-ca35152aa4c1', 'f29bf6f3-6b31-4e33-ac1e-e46e28a08b2f'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:09:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-eea88dfe-1265-44d5-8edd-3a9511b63df0 tempest-SnapshotMetadataTestJSON-1502463189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-eea88dfe-1265-44d5-8edd-3a9511b63df0 tempest-SnapshotMetadataTestJSON-1502463189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:02 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-eea88dfe-1265-44d5-8edd-3a9511b63df0 tempest-SnapshotMetadataTestJSON-1502463189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:09:02 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-eea88dfe-1265-44d5-8edd-3a9511b63df0 tempest-SnapshotMetadataTestJSON-1502463189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:09:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-eea88dfe-1265-44d5-8edd-3a9511b63df0 tempest-SnapshotMetadataTestJSON-1502463189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-eea88dfe-1265-44d5-8edd-3a9511b63df0 tempest-SnapshotMetadataTestJSON-1502463189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:02 devstack sudo[90769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:09:02 devstack sudo[90769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:02 devstack sudo[90769]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-eea88dfe-1265-44d5-8edd-3a9511b63df0 tempest-SnapshotMetadataTestJSON-1502463189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.499s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:02 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-eea88dfe-1265-44d5-8edd-3a9511b63df0 tempest-SnapshotMetadataTestJSON-1502463189 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:09:02 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-eea88dfe-1265-44d5-8edd-3a9511b63df0 tempest-SnapshotMetadataTestJSON-1502463189 None] Deleted volume successfully. Nov 03 13:09:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-eea88dfe-1265-44d5-8edd-3a9511b63df0 tempest-SnapshotMetadataTestJSON-1502463189 None] Lock "cinder-d43cff40-7bc2-452f-ab73-7bd6460961d0-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:07 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-7ded3e12-6cbe-40ac-9fb5-45f0ab5a7861 req-283799b6-79c2-4a81-9565-176b9a3e3205 tempest-AttachVolumeTestJSON-2041145724 None] Terminate volume connection completed successfully. Nov 03 13:09:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-7ded3e12-6cbe-40ac-9fb5-45f0ab5a7861 req-283799b6-79c2-4a81-9565-176b9a3e3205 tempest-AttachVolumeTestJSON-2041145724 None] Deleting attachment cbc16996-46a7-4a6e-ada4-ded4c9a9166a. {{(pid=86725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:09:07 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:09:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] Flow 'volume_create_manager' (b7af4da9-9967-4ca6-8ac1-854e6fb590b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:09:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74809f48-3558-4bca-9a18-0eeb3fa2f6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74809f48-3558-4bca-9a18-0eeb3fa2f6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-642870089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3903e6e5-7106-49ac-965a-2330db44efbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2579361f74474b4e8bc517008d6e9801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:09:08Z,use_quota=True,user_id='a5dbb460fbc846fda422bd1937d68762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64b19989-d353-4b37-89ab-d9ebaf86f8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64b19989-d353-4b37-89ab-d9ebaf86f8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b59c191-0425-4b30-8d00-dd6c51c9e25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b59c191-0425-4b30-8d00-dd6c51c9e25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3903e6e5-7106-49ac-965a-2330db44efbb', 'volume_name': 'volume-3903e6e5-7106-49ac-965a-2330db44efbb', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (117c027b-6c0a-4809-abb0-507775436739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (117c027b-6c0a-4809-abb0-507775436739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f239dbf6-2f6a-462b-acb1-053116ca65a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:08 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] Volume 3903e6e5-7106-49ac-965a-2330db44efbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3903e6e5-7106-49ac-965a-2330db44efbb', 'volume_size': 1} Nov 03 13:09:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:08 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-642870089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3903e6e5-7106-49ac-965a-2330db44efbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2579361f74474b4e8bc517008d6e9801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:09:08Z,use_quota=True,user_id='a5dbb460fbc846fda422bd1937d68762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:09:08 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] Creating volume 3903e6e5-7106-49ac-965a-2330db44efbb {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:09:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:08 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:09:08 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:09:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:08 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:09:08 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:09:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:08 devstack sudo[90805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb 1073741824 Nov 03 13:09:08 devstack sudo[90805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:08 devstack sudo[90805]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb 1073741824" returned: 0 in 0.841s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:09 devstack sudo[90817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb Nov 03 13:09:09 devstack sudo[90817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:09 devstack sudo[90817]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb" returned: 0 in 0.334s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:09 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:09:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f239dbf6-2f6a-462b-acb1-053116ca65a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3903e6e5-7106-49ac-965a-2330db44efbb', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccffc36f-e35c-4624-a1d2-11107f505375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:09 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] Volume volume-3903e6e5-7106-49ac-965a-2330db44efbb (3903e6e5-7106-49ac-965a-2330db44efbb): created successfully Nov 03 13:09:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccffc36f-e35c-4624-a1d2-11107f505375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] Flow 'volume_create_manager' (b7af4da9-9967-4ca6-8ac1-854e6fb590b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:09:09 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-a09135bf-f074-4ac4-9b96-9386d64c0507 tempest-VolumesDeleteCascade-1765742457 None] Created volume successfully. Nov 03 13:09:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-10d4acad-27f3-40d7-8351-8f0d1f3de527 tempest-VolumesDeleteCascade-1765742457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-10d4acad-27f3-40d7-8351-8f0d1f3de527 tempest-VolumesDeleteCascade-1765742457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:10 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-10d4acad-27f3-40d7-8351-8f0d1f3de527 tempest-VolumesDeleteCascade-1765742457 None] Creating offline snapshot 62cf50de-63dc-4f59-b30d-2f2477b9496e of volume 3903e6e5-7106-49ac-965a-2330db44efbb {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:09:10 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40d4c8e-105b-4b16-bc4f-ca944ae9040b]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-10d4acad-27f3-40d7-8351-8f0d1f3de527 tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:10 devstack sudo[90822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb Nov 03 13:09:10 devstack sudo[90822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:10 devstack sudo[90822]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-10d4acad-27f3-40d7-8351-8f0d1f3de527 tempest-VolumesDeleteCascade-1765742457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb" returned: 0 in 0.439s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-10d4acad-27f3-40d7-8351-8f0d1f3de527 tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.62cf50de-63dc-4f59-b30d-2f2477b9496e 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:10 devstack sudo[90827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.62cf50de-63dc-4f59-b30d-2f2477b9496e 1G Nov 03 13:09:10 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:11 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-10d4acad-27f3-40d7-8351-8f0d1f3de527 tempest-VolumesDeleteCascade-1765742457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.62cf50de-63dc-4f59-b30d-2f2477b9496e 1G" returned: 0 in 0.562s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-10d4acad-27f3-40d7-8351-8f0d1f3de527 tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3903e6e5-7106-49ac-965a-2330db44efbb -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.62cf50de-63dc-4f59-b30d-2f2477b9496e {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:11 devstack sudo[90837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3903e6e5-7106-49ac-965a-2330db44efbb -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.62cf50de-63dc-4f59-b30d-2f2477b9496e Nov 03 13:09:11 devstack sudo[90837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:11 devstack sudo[90837]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-10d4acad-27f3-40d7-8351-8f0d1f3de527 tempest-VolumesDeleteCascade-1765742457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3903e6e5-7106-49ac-965a-2330db44efbb -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.62cf50de-63dc-4f59-b30d-2f2477b9496e" returned: 0 in 0.322s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:11 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-10d4acad-27f3-40d7-8351-8f0d1f3de527 tempest-VolumesDeleteCascade-1765742457 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.62cf50de-63dc-4f59-b30d-2f2477b9496e is being set with open permissions: ugo+rw Nov 03 13:09:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-10d4acad-27f3-40d7-8351-8f0d1f3de527 tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.62cf50de-63dc-4f59-b30d-2f2477b9496e {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:11 devstack sudo[90843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.62cf50de-63dc-4f59-b30d-2f2477b9496e Nov 03 13:09:11 devstack sudo[90843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:12 devstack sudo[90843]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-10d4acad-27f3-40d7-8351-8f0d1f3de527 tempest-VolumesDeleteCascade-1765742457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.62cf50de-63dc-4f59-b30d-2f2477b9496e" returned: 0 in 0.261s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-10d4acad-27f3-40d7-8351-8f0d1f3de527 tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:12 devstack sudo[90846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.info Nov 03 13:09:12 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:12 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-10d4acad-27f3-40d7-8351-8f0d1f3de527 tempest-VolumesDeleteCascade-1765742457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.info" returned: 0 in 0.255s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:12 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-10d4acad-27f3-40d7-8351-8f0d1f3de527 tempest-VolumesDeleteCascade-1765742457 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.info is being set with open permissions: ugo+rw Nov 03 13:09:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-10d4acad-27f3-40d7-8351-8f0d1f3de527 tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:12 devstack sudo[90849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.info Nov 03 13:09:12 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:12 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-10d4acad-27f3-40d7-8351-8f0d1f3de527 tempest-VolumesDeleteCascade-1765742457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.info" returned: 0 in 0.307s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-10d4acad-27f3-40d7-8351-8f0d1f3de527 tempest-VolumesDeleteCascade-1765742457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.284s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:12 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-10d4acad-27f3-40d7-8351-8f0d1f3de527 tempest-VolumesDeleteCascade-1765742457 None] Create snapshot completed successfully Nov 03 13:09:13 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0bab6192-d012-44f8-a071-35dba002f28a tempest-TaggedAttachmentsTest-987816765 None] Acquiring lock "cinder-5ff0bbcb-640f-4806-88f7-32af1ce1fe8f-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:13 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0bab6192-d012-44f8-a071-35dba002f28a tempest-TaggedAttachmentsTest-987816765 None] Lock "cinder-5ff0bbcb-640f-4806-88f7-32af1ce1fe8f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:13 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0bab6192-d012-44f8-a071-35dba002f28a tempest-TaggedAttachmentsTest-987816765 None] Acquiring lock "cinder-quobyte-5ff0bbcb-640f-4806-88f7-32af1ce1fe8f" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:13 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0bab6192-d012-44f8-a071-35dba002f28a tempest-TaggedAttachmentsTest-987816765 None] Lock "cinder-quobyte-5ff0bbcb-640f-4806-88f7-32af1ce1fe8f" acquired by "delete_volume" :: waited 0.024s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:13 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9c8ae4-89a1-45ce-a3f4-02cff7edf957]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0bab6192-d012-44f8-a071-35dba002f28a tempest-TaggedAttachmentsTest-987816765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5ff0bbcb-640f-4806-88f7-32af1ce1fe8f {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d315b4ac-da07-40cd-a6cb-f1affb846071 tempest-VolumesDeleteCascade-1765742457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d315b4ac-da07-40cd-a6cb-f1affb846071 tempest-VolumesDeleteCascade-1765742457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-d315b4ac-da07-40cd-a6cb-f1affb846071 tempest-VolumesDeleteCascade-1765742457 None] Creating offline snapshot d1bc6e41-17cf-475b-ae4a-88e0ab04bf01 of volume 3903e6e5-7106-49ac-965a-2330db44efbb {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:09:14 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc4cf1c-3aa5-4967-9d85-c3d70545fe3a]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d315b4ac-da07-40cd-a6cb-f1affb846071 tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.62cf50de-63dc-4f59-b30d-2f2477b9496e {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:14 devstack sudo[90882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5ff0bbcb-640f-4806-88f7-32af1ce1fe8f Nov 03 13:09:14 devstack sudo[90882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:14 devstack sudo[90883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.62cf50de-63dc-4f59-b30d-2f2477b9496e Nov 03 13:09:14 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:14 devstack sudo[90882]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0bab6192-d012-44f8-a071-35dba002f28a tempest-TaggedAttachmentsTest-987816765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5ff0bbcb-640f-4806-88f7-32af1ce1fe8f" returned: 0 in 0.836s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0bab6192-d012-44f8-a071-35dba002f28a tempest-TaggedAttachmentsTest-987816765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5ff0bbcb-640f-4806-88f7-32af1ce1fe8f {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:14 devstack sudo[90942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5ff0bbcb-640f-4806-88f7-32af1ce1fe8f Nov 03 13:09:14 devstack sudo[90942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:14 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d315b4ac-da07-40cd-a6cb-f1affb846071 tempest-VolumesDeleteCascade-1765742457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.62cf50de-63dc-4f59-b30d-2f2477b9496e" returned: 0 in 0.854s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:14 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-d315b4ac-da07-40cd-a6cb-f1affb846071 tempest-VolumesDeleteCascade-1765742457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3903e6e5-7106-49ac-965a-2330db44efbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:09:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d315b4ac-da07-40cd-a6cb-f1affb846071 tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.62cf50de-63dc-4f59-b30d-2f2477b9496e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.d1bc6e41-17cf-475b-ae4a-88e0ab04bf01 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:14 devstack sudo[90950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.62cf50de-63dc-4f59-b30d-2f2477b9496e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.d1bc6e41-17cf-475b-ae4a-88e0ab04bf01 1G Nov 03 13:09:14 devstack sudo[90950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:15 devstack sudo[90942]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0bab6192-d012-44f8-a071-35dba002f28a tempest-TaggedAttachmentsTest-987816765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5ff0bbcb-640f-4806-88f7-32af1ce1fe8f" returned: 0 in 0.458s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:15 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0bab6192-d012-44f8-a071-35dba002f28a tempest-TaggedAttachmentsTest-987816765 None] Lock "cinder-quobyte-5ff0bbcb-640f-4806-88f7-32af1ce1fe8f" released by "delete_volume" :: held 1.391s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:15 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-0bab6192-d012-44f8-a071-35dba002f28a tempest-TaggedAttachmentsTest-987816765 None] Created reservations ['b7be2c94-7110-48a8-acdd-6ad85eece523', '66b1353a-811f-4493-8a68-da6905c2b6c1', 'ece87086-68b5-4de4-a805-387b0b98cafd', 'ba210478-9843-46cb-a7f9-70c29831b4e7'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:09:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0bab6192-d012-44f8-a071-35dba002f28a tempest-TaggedAttachmentsTest-987816765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0bab6192-d012-44f8-a071-35dba002f28a tempest-TaggedAttachmentsTest-987816765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:15 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0bab6192-d012-44f8-a071-35dba002f28a tempest-TaggedAttachmentsTest-987816765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:09:15 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0bab6192-d012-44f8-a071-35dba002f28a tempest-TaggedAttachmentsTest-987816765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:09:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0bab6192-d012-44f8-a071-35dba002f28a tempest-TaggedAttachmentsTest-987816765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0bab6192-d012-44f8-a071-35dba002f28a tempest-TaggedAttachmentsTest-987816765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:15 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:09:15 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:15 devstack sudo[90950]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d315b4ac-da07-40cd-a6cb-f1affb846071 tempest-VolumesDeleteCascade-1765742457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.62cf50de-63dc-4f59-b30d-2f2477b9496e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.d1bc6e41-17cf-475b-ae4a-88e0ab04bf01 1G" returned: 0 in 1.025s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d315b4ac-da07-40cd-a6cb-f1affb846071 tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3903e6e5-7106-49ac-965a-2330db44efbb.62cf50de-63dc-4f59-b30d-2f2477b9496e -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.d1bc6e41-17cf-475b-ae4a-88e0ab04bf01 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:15 devstack sudo[90977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3903e6e5-7106-49ac-965a-2330db44efbb.62cf50de-63dc-4f59-b30d-2f2477b9496e -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.d1bc6e41-17cf-475b-ae4a-88e0ab04bf01 Nov 03 13:09:15 devstack sudo[90977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:16 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0bab6192-d012-44f8-a071-35dba002f28a tempest-TaggedAttachmentsTest-987816765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.615s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:16 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-0bab6192-d012-44f8-a071-35dba002f28a tempest-TaggedAttachmentsTest-987816765 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:09:16 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-0bab6192-d012-44f8-a071-35dba002f28a tempest-TaggedAttachmentsTest-987816765 None] Deleted volume successfully. Nov 03 13:09:16 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0bab6192-d012-44f8-a071-35dba002f28a tempest-TaggedAttachmentsTest-987816765 None] Lock "cinder-5ff0bbcb-640f-4806-88f7-32af1ce1fe8f-delete_volume" released by "delete_volume" :: held 2.525s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:16 devstack sudo[90977]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d315b4ac-da07-40cd-a6cb-f1affb846071 tempest-VolumesDeleteCascade-1765742457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3903e6e5-7106-49ac-965a-2330db44efbb.62cf50de-63dc-4f59-b30d-2f2477b9496e -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.d1bc6e41-17cf-475b-ae4a-88e0ab04bf01" returned: 0 in 0.623s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:16 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-d315b4ac-da07-40cd-a6cb-f1affb846071 tempest-VolumesDeleteCascade-1765742457 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.d1bc6e41-17cf-475b-ae4a-88e0ab04bf01 is being set with open permissions: ugo+rw Nov 03 13:09:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d315b4ac-da07-40cd-a6cb-f1affb846071 tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.d1bc6e41-17cf-475b-ae4a-88e0ab04bf01 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:16 devstack sudo[90986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.d1bc6e41-17cf-475b-ae4a-88e0ab04bf01 Nov 03 13:09:16 devstack sudo[90986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:16 devstack sudo[90986]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d315b4ac-da07-40cd-a6cb-f1affb846071 tempest-VolumesDeleteCascade-1765742457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.d1bc6e41-17cf-475b-ae4a-88e0ab04bf01" returned: 0 in 0.361s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d315b4ac-da07-40cd-a6cb-f1affb846071 tempest-VolumesDeleteCascade-1765742457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.050s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:17 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-d315b4ac-da07-40cd-a6cb-f1affb846071 tempest-VolumesDeleteCascade-1765742457 None] Create snapshot completed successfully Nov 03 13:09:18 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Acquiring lock "cinder-3903e6e5-7106-49ac-965a-2330db44efbb-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:18 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Lock "cinder-3903e6e5-7106-49ac-965a-2330db44efbb-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:18 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Performing cascade delete. {{(pid=86725) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 03 13:09:18 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Acquiring lock "cinder-62cf50de-63dc-4f59-b30d-2f2477b9496e-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:18 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Lock "cinder-62cf50de-63dc-4f59-b30d-2f2477b9496e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:18 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Acquiring lock "cinder-quobyte-3903e6e5-7106-49ac-965a-2330db44efbb" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:18 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Lock "cinder-quobyte-3903e6e5-7106-49ac-965a-2330db44efbb" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:18 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Acquiring lock "cinder-quobyte-62cf50de-63dc-4f59-b30d-2f2477b9496e" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:18 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Lock "cinder-quobyte-62cf50de-63dc-4f59-b30d-2f2477b9496e" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:18 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Deleting offline snapshot 62cf50de-63dc-4f59-b30d-2f2477b9496e of volume 3903e6e5-7106-49ac-965a-2330db44efbb {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:09:18 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] snapshot_file for this snap is: volume-3903e6e5-7106-49ac-965a-2330db44efbb.62cf50de-63dc-4f59-b30d-2f2477b9496e {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:09:18 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05a651d-d576-4954-9667-bc232aa96851]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.62cf50de-63dc-4f59-b30d-2f2477b9496e {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:18 devstack sudo[91010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.62cf50de-63dc-4f59-b30d-2f2477b9496e Nov 03 13:09:18 devstack sudo[91010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:19 devstack sudo[91010]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.62cf50de-63dc-4f59-b30d-2f2477b9496e" returned: 0 in 0.624s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:19 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3903e6e5-7106-49ac-965a-2330db44efbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:09:19 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[accfa9c8-1b24-4096-b672-70727db8f529]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:19 devstack sudo[91022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb Nov 03 13:09:19 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:19 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb" returned: 0 in 0.498s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:19 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcf3f94-240e-44ae-8412-4ae17d852604]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.d1bc6e41-17cf-475b-ae4a-88e0ab04bf01 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:20 devstack sudo[91028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.d1bc6e41-17cf-475b-ae4a-88e0ab04bf01 Nov 03 13:09:20 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:20 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.d1bc6e41-17cf-475b-ae4a-88e0ab04bf01" returned: 0 in 0.447s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:20 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3903e6e5-7106-49ac-965a-2330db44efbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:09:20 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4eea511-4d2e-4f23-afb2-4d15ba754508]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.62cf50de-63dc-4f59-b30d-2f2477b9496e {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:20 devstack sudo[91036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.62cf50de-63dc-4f59-b30d-2f2477b9496e Nov 03 13:09:20 devstack sudo[91036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:20 devstack sudo[91036]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.62cf50de-63dc-4f59-b30d-2f2477b9496e" returned: 0 in 0.458s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:20 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3903e6e5-7106-49ac-965a-2330db44efbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:09:20 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a638ea9-cff9-4502-888a-b7d6e4db1489]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:21 devstack sudo[91041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb Nov 03 13:09:21 devstack sudo[91041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:21 devstack sudo[91041]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb" returned: 0 in 0.799s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.62cf50de-63dc-4f59-b30d-2f2477b9496e {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:21 devstack sudo[91087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.62cf50de-63dc-4f59-b30d-2f2477b9496e Nov 03 13:09:21 devstack sudo[91087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:22 devstack sudo[91087]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.62cf50de-63dc-4f59-b30d-2f2477b9496e" returned: 0 in 0.871s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.62cf50de-63dc-4f59-b30d-2f2477b9496e {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:22 devstack sudo[91113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.62cf50de-63dc-4f59-b30d-2f2477b9496e Nov 03 13:09:22 devstack sudo[91113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:22 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:UPDATE=72,cinder:SELECT=64,cinder:INSERT=21,cinder:DELETE=8 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:09:22 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=75,cinder:UPDATE=71,cinder:DELETE=6,cinder:INSERT=11 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:09:23 devstack sudo[91113]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.62cf50de-63dc-4f59-b30d-2f2477b9496e" returned: 0 in 0.720s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3903e6e5-7106-49ac-965a-2330db44efbb /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.d1bc6e41-17cf-475b-ae4a-88e0ab04bf01 -F qcow2 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:23 devstack sudo[91125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3903e6e5-7106-49ac-965a-2330db44efbb /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.d1bc6e41-17cf-475b-ae4a-88e0ab04bf01 -F qcow2 Nov 03 13:09:23 devstack sudo[91125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:24 devstack sudo[91125]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3903e6e5-7106-49ac-965a-2330db44efbb /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.d1bc6e41-17cf-475b-ae4a-88e0ab04bf01 -F qcow2" returned: 0 in 0.821s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:24 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Lock "cinder-quobyte-62cf50de-63dc-4f59-b30d-2f2477b9496e" released by "_delete_snapshot" :: held 5.508s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:24 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Lock "cinder-quobyte-3903e6e5-7106-49ac-965a-2330db44efbb" released by "delete_snapshot" :: held 5.582s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:24 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Created reservations ['9e49d1ed-91ff-4658-9a35-151caf67d720', '49cb9cfc-cec9-4a15-8225-a71bc89a18b6', 'a55f7c0c-65a0-4bac-a78f-f3d1cd5cd004', '6715968d-f3c7-416b-be69-3272a0c1d4e4'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:09:24 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Delete snapshot completed successfully. Nov 03 13:09:24 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Lock "cinder-62cf50de-63dc-4f59-b30d-2f2477b9496e-delete_snapshot" released by "delete_snapshot" :: held 5.964s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:24 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Acquiring lock "cinder-d1bc6e41-17cf-475b-ae4a-88e0ab04bf01-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:24 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Lock "cinder-d1bc6e41-17cf-475b-ae4a-88e0ab04bf01-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:24 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Acquiring lock "cinder-quobyte-3903e6e5-7106-49ac-965a-2330db44efbb" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:24 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Lock "cinder-quobyte-3903e6e5-7106-49ac-965a-2330db44efbb" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:24 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Acquiring lock "cinder-quobyte-d1bc6e41-17cf-475b-ae4a-88e0ab04bf01" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:24 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Lock "cinder-quobyte-d1bc6e41-17cf-475b-ae4a-88e0ab04bf01" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:24 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Deleting offline snapshot d1bc6e41-17cf-475b-ae4a-88e0ab04bf01 of volume 3903e6e5-7106-49ac-965a-2330db44efbb {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:09:24 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] snapshot_file for this snap is: volume-3903e6e5-7106-49ac-965a-2330db44efbb.d1bc6e41-17cf-475b-ae4a-88e0ab04bf01 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:09:24 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26d434a-a778-42d9-b071-f2d3ad369e23]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.d1bc6e41-17cf-475b-ae4a-88e0ab04bf01 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:24 devstack sudo[91132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.d1bc6e41-17cf-475b-ae4a-88e0ab04bf01 Nov 03 13:09:24 devstack sudo[91132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:25 devstack sudo[91132]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.d1bc6e41-17cf-475b-ae4a-88e0ab04bf01" returned: 0 in 0.502s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3903e6e5-7106-49ac-965a-2330db44efbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:09:25 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[7690b451-d94d-4803-8e31-8cbd5563a50f]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:25 devstack sudo[91140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb Nov 03 13:09:25 devstack sudo[91140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:25 devstack sudo[91140]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb" returned: 0 in 0.427s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.d1bc6e41-17cf-475b-ae4a-88e0ab04bf01 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:25 devstack sudo[91145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.d1bc6e41-17cf-475b-ae4a-88e0ab04bf01 Nov 03 13:09:25 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:26 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.d1bc6e41-17cf-475b-ae4a-88e0ab04bf01" returned: 0 in 0.666s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.d1bc6e41-17cf-475b-ae4a-88e0ab04bf01 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:26 devstack sudo[91150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.d1bc6e41-17cf-475b-ae4a-88e0ab04bf01 Nov 03 13:09:26 devstack sudo[91150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:26 devstack sudo[91150]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb.d1bc6e41-17cf-475b-ae4a-88e0ab04bf01" returned: 0 in 0.448s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:26 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Lock "cinder-quobyte-d1bc6e41-17cf-475b-ae4a-88e0ab04bf01" released by "_delete_snapshot" :: held 2.272s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:26 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Lock "cinder-quobyte-3903e6e5-7106-49ac-965a-2330db44efbb" released by "delete_snapshot" :: held 2.334s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:27 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Created reservations ['13effd44-3593-4454-bbe5-45a0fbd4a38e', '0f6481bf-c608-4e78-964f-4a68fee02690', '16ff9424-5d08-4f56-b5f8-240ad356b477', '70fb6f40-6b11-4407-88ab-c3b8cf305b15'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:09:27 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Delete snapshot completed successfully. Nov 03 13:09:27 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Lock "cinder-d1bc6e41-17cf-475b-ae4a-88e0ab04bf01-delete_snapshot" released by "delete_snapshot" :: held 2.673s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Snapshots deleted, issuing volume delete {{(pid=86725) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 03 13:09:27 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Acquiring lock "cinder-quobyte-3903e6e5-7106-49ac-965a-2330db44efbb" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:27 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Lock "cinder-quobyte-3903e6e5-7106-49ac-965a-2330db44efbb" acquired by "delete_volume" :: waited 0.034s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:27 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a5d076-6af2-461e-a57e-173c52cd355f]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:27 devstack sudo[91154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb Nov 03 13:09:27 devstack sudo[91154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:28 devstack sudo[91154]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb" returned: 0 in 0.616s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:28 devstack sudo[91160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb Nov 03 13:09:28 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:28 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3903e6e5-7106-49ac-965a-2330db44efbb" returned: 0 in 0.614s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:28 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Lock "cinder-quobyte-3903e6e5-7106-49ac-965a-2330db44efbb" released by "delete_volume" :: held 1.458s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:28 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Created reservations ['292806e9-18ed-465e-9b3b-b7b522189598', 'dcf66bc4-e800-49ce-a4c1-cc9596e96203', '249c4d90-6ede-4678-9a12-8e2c0a5b4c60', '2fd8b4eb-3d2e-420a-ad90-845f248f487b'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:09:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:28 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:09:28 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:09:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:29 devstack sudo[91165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:09:29 devstack sudo[91165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:29 devstack sudo[91165]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.326s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:29 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:09:29 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Deleted volume successfully. Nov 03 13:09:29 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8b43e3ea-49ec-4f94-aca1-7579921b55de tempest-VolumesDeleteCascade-1765742457 None] Lock "cinder-3903e6e5-7106-49ac-965a-2330db44efbb-delete_volume" released by "delete_volume" :: held 10.976s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:30 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:09:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] Flow 'volume_create_manager' (7569a298-95de-415c-8370-2dc9dad30fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:09:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb7487b4-4dec-40ea-837f-22ed2ea5d28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb7487b4-4dec-40ea-837f-22ed2ea5d28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-487507947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d438928d-dc29-4950-8d7c-3fa1162a7ef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2579361f74474b4e8bc517008d6e9801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:09:31Z,use_quota=True,user_id='a5dbb460fbc846fda422bd1937d68762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d44f94-c878-4058-99a1-9e6393c7a8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d44f94-c878-4058-99a1-9e6393c7a8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d31b822c-146d-4301-9fbc-6b1b52a24912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d31b822c-146d-4301-9fbc-6b1b52a24912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd438928d-dc29-4950-8d7c-3fa1162a7ef1', 'volume_name': 'volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f698e9e-3fc0-414f-bb9d-a638c5edac64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f698e9e-3fc0-414f-bb9d-a638c5edac64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c588e397-522e-4ce4-92f9-4768345cdc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:30 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] Volume d438928d-dc29-4950-8d7c-3fa1162a7ef1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1', 'volume_size': 1} Nov 03 13:09:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:30 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-487507947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d438928d-dc29-4950-8d7c-3fa1162a7ef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2579361f74474b4e8bc517008d6e9801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:09:31Z,use_quota=True,user_id='a5dbb460fbc846fda422bd1937d68762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:09:30 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] Creating volume d438928d-dc29-4950-8d7c-3fa1162a7ef1 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:09:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:30 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:09:30 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:09:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:30 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:09:30 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:09:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:30 devstack sudo[91171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1 1073741824 Nov 03 13:09:30 devstack sudo[91171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:31 devstack sudo[91171]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1 1073741824" returned: 0 in 0.483s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:31 devstack sudo[91176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1 Nov 03 13:09:31 devstack sudo[91176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:31 devstack sudo[91176]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1" returned: 0 in 0.319s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:31 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:09:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c588e397-522e-4ce4-92f9-4768345cdc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28f9dc38-84fd-454f-a0c9-61deb4d9e8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:31 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] Volume volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1 (d438928d-dc29-4950-8d7c-3fa1162a7ef1): created successfully Nov 03 13:09:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28f9dc38-84fd-454f-a0c9-61deb4d9e8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] Flow 'volume_create_manager' (7569a298-95de-415c-8370-2dc9dad30fe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:09:31 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-3dd9a2ec-66e8-480a-ba72-f61e35b1be22 tempest-VolumesDeleteCascade-1765742457 None] Created volume successfully. Nov 03 13:09:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2eb27095-377c-41e4-8cb9-633f6977d164 tempest-VolumesDeleteCascade-1765742457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2eb27095-377c-41e4-8cb9-633f6977d164 tempest-VolumesDeleteCascade-1765742457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:33 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-2eb27095-377c-41e4-8cb9-633f6977d164 tempest-VolumesDeleteCascade-1765742457 None] Creating offline snapshot e37afb78-86df-414f-b7cf-a2a6eba01765 of volume d438928d-dc29-4950-8d7c-3fa1162a7ef1 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:09:33 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[07196d2d-812d-4a7f-b552-c45b71691471]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2eb27095-377c-41e4-8cb9-633f6977d164 tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:33 devstack sudo[91180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1 Nov 03 13:09:33 devstack sudo[91180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:33 devstack sudo[91180]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2eb27095-377c-41e4-8cb9-633f6977d164 tempest-VolumesDeleteCascade-1765742457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1" returned: 0 in 0.443s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2eb27095-377c-41e4-8cb9-633f6977d164 tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1.e37afb78-86df-414f-b7cf-a2a6eba01765 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:33 devstack sudo[91186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1.e37afb78-86df-414f-b7cf-a2a6eba01765 1G Nov 03 13:09:33 devstack sudo[91186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:33 devstack sudo[91186]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2eb27095-377c-41e4-8cb9-633f6977d164 tempest-VolumesDeleteCascade-1765742457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1.e37afb78-86df-414f-b7cf-a2a6eba01765 1G" returned: 0 in 0.427s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2eb27095-377c-41e4-8cb9-633f6977d164 tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1.e37afb78-86df-414f-b7cf-a2a6eba01765 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:33 devstack sudo[91192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1.e37afb78-86df-414f-b7cf-a2a6eba01765 Nov 03 13:09:33 devstack sudo[91192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:34 devstack sudo[91192]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2eb27095-377c-41e4-8cb9-633f6977d164 tempest-VolumesDeleteCascade-1765742457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1.e37afb78-86df-414f-b7cf-a2a6eba01765" returned: 0 in 0.315s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:34 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-2eb27095-377c-41e4-8cb9-633f6977d164 tempest-VolumesDeleteCascade-1765742457 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1.e37afb78-86df-414f-b7cf-a2a6eba01765 is being set with open permissions: ugo+rw Nov 03 13:09:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2eb27095-377c-41e4-8cb9-633f6977d164 tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1.e37afb78-86df-414f-b7cf-a2a6eba01765 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:34 devstack sudo[91197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1.e37afb78-86df-414f-b7cf-a2a6eba01765 Nov 03 13:09:34 devstack sudo[91197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:34 devstack sudo[91197]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2eb27095-377c-41e4-8cb9-633f6977d164 tempest-VolumesDeleteCascade-1765742457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1.e37afb78-86df-414f-b7cf-a2a6eba01765" returned: 0 in 0.273s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2eb27095-377c-41e4-8cb9-633f6977d164 tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:34 devstack sudo[91200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1.info Nov 03 13:09:34 devstack sudo[91200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:34 devstack sudo[91200]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2eb27095-377c-41e4-8cb9-633f6977d164 tempest-VolumesDeleteCascade-1765742457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1.info" returned: 0 in 0.257s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:34 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-2eb27095-377c-41e4-8cb9-633f6977d164 tempest-VolumesDeleteCascade-1765742457 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1.info is being set with open permissions: ugo+rw Nov 03 13:09:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2eb27095-377c-41e4-8cb9-633f6977d164 tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:34 devstack sudo[91203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1.info Nov 03 13:09:34 devstack sudo[91203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:35 devstack sudo[91203]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2eb27095-377c-41e4-8cb9-633f6977d164 tempest-VolumesDeleteCascade-1765742457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1.info" returned: 0 in 0.289s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2eb27095-377c-41e4-8cb9-633f6977d164 tempest-VolumesDeleteCascade-1765742457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.115s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:35 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-2eb27095-377c-41e4-8cb9-633f6977d164 tempest-VolumesDeleteCascade-1765742457 None] Create snapshot completed successfully Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Flow 'volume_create_manager' (244d7e14-730f-4393-947f-a85de93e30f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0303944e-b8cc-4f5a-b8a7-e4a66aa9c62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0303944e-b8cc-4f5a-b8a7-e4a66aa9c62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-309891676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd16fab3-6fac-4853-9f77-73dba7db455d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2579361f74474b4e8bc517008d6e9801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e37afb78-86df-414f-b7cf-a2a6eba01765,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:09:37Z,use_quota=True,user_id='a5dbb460fbc846fda422bd1937d68762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (225ff9fa-f6d3-4fac-ba63-b172ab69a0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (225ff9fa-f6d3-4fac-ba63-b172ab69a0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e4bf11b-7e17-4ad4-a267-408f8cff4f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e4bf11b-7e17-4ad4-a267-408f8cff4f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fd16fab3-6fac-4853-9f77-73dba7db455d', 'volume_name': 'volume-fd16fab3-6fac-4853-9f77-73dba7db455d', 'volume_size': 1, 'snapshot_id': 'e37afb78-86df-414f-b7cf-a2a6eba01765'}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (258b8339-15a5-4d4f-9737-8005cfe863ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (258b8339-15a5-4d4f-9737-8005cfe863ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfff340a-2936-4acf-930d-8ceaa5858001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:37 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Volume fd16fab3-6fac-4853-9f77-73dba7db455d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fd16fab3-6fac-4853-9f77-73dba7db455d', 'volume_size': 1, 'snapshot_id': 'e37afb78-86df-414f-b7cf-a2a6eba01765'} Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Acquiring lock "cinder-quobyte-e37afb78-86df-414f-b7cf-a2a6eba01765-fd16fab3-6fac-4853-9f77-73dba7db455d" by "_create_volume_from_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Lock "cinder-quobyte-e37afb78-86df-414f-b7cf-a2a6eba01765-fd16fab3-6fac-4853-9f77-73dba7db455d" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Creating volume fd16fab3-6fac-4853-9f77-73dba7db455d from snapshot e37afb78-86df-414f-b7cf-a2a6eba01765 {{(pid=86725) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Acquiring lock "cinder-quobyte-fd16fab3-6fac-4853-9f77-73dba7db455d" by "_copy_volume_from_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Lock "cinder-quobyte-fd16fab3-6fac-4853-9f77-73dba7db455d" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] snapshot: e37afb78-86df-414f-b7cf-a2a6eba01765, volume: fd16fab3-6fac-4853-9f77-73dba7db455d, {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[31bc146b-c0dd-4a31-b11f-7149b92f967a]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1.e37afb78-86df-414f-b7cf-a2a6eba01765 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:37 devstack sudo[91208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1.e37afb78-86df-414f-b7cf-a2a6eba01765 Nov 03 13:09:37 devstack sudo[91208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:37 devstack sudo[91208]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1.e37afb78-86df-414f-b7cf-a2a6eba01765" returned: 0 in 0.453s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5ed847-627e-46c8-92fd-c13344a5b49b]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:37 devstack sudo[91244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1 Nov 03 13:09:37 devstack sudo[91244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:38 devstack sudo[91244]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1" returned: 0 in 0.403s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:38 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1 {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 13:09:38 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Creating direct copy from snapshot {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 13:09:38 devstack cinder-volume[86725]: DEBUG cinder.utils [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Path /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-fd16fab3-6fac-4853-9f77-73dba7db455d not found in is_blk_device check {{(pid=86725) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 13:09:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-fd16fab3-6fac-4853-9f77-73dba7db455d {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:38 devstack sudo[91249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-fd16fab3-6fac-4853-9f77-73dba7db455d Nov 03 13:09:38 devstack sudo[91249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:47 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=19,cinder:INSERT=9,cinder:UPDATE=26,cinder:DELETE=3 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:09:47 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=23,cinder:INSERT=5,cinder:UPDATE=21 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:09:47 devstack sudo[91249]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-fd16fab3-6fac-4853-9f77-73dba7db455d" returned: 0 in 9.449s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:47 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1, size 1024.00 MB, duration 9.45 sec, destination /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-fd16fab3-6fac-4853-9f77-73dba7db455d {{(pid=86725) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:09:47 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Converted 1024.00 MB image at 108.32 MB/s Nov 03 13:09:47 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-fd16fab3-6fac-4853-9f77-73dba7db455d is being set with open permissions: ugo+rw Nov 03 13:09:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-fd16fab3-6fac-4853-9f77-73dba7db455d {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:47 devstack sudo[91343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-fd16fab3-6fac-4853-9f77-73dba7db455d Nov 03 13:09:47 devstack sudo[91343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:47 devstack sudo[91343]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-fd16fab3-6fac-4853-9f77-73dba7db455d" returned: 0 in 0.354s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:48 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Lock "cinder-quobyte-fd16fab3-6fac-4853-9f77-73dba7db455d" released by "_copy_volume_from_snapshot" :: held 10.773s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:48 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Lock "cinder-quobyte-e37afb78-86df-414f-b7cf-a2a6eba01765-fd16fab3-6fac-4853-9f77-73dba7db455d" released by "_create_volume_from_snapshot" :: held 10.859s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.880s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:48 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfff340a-2936-4acf-930d-8ceaa5858001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd16fab3-6fac-4853-9f77-73dba7db455d', 'volume_size': 1, 'snapshot_id': 'e37afb78-86df-414f-b7cf-a2a6eba01765'}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:48 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38278a96-7a66-4c3f-9f72-92a7ab1340ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:48 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Volume volume-fd16fab3-6fac-4853-9f77-73dba7db455d (fd16fab3-6fac-4853-9f77-73dba7db455d): created successfully Nov 03 13:09:48 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38278a96-7a66-4c3f-9f72-92a7ab1340ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:48 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Flow 'volume_create_manager' (244d7e14-730f-4393-947f-a85de93e30f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:09:48 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-1d3da07a-35c6-4202-9db7-94959843e38e tempest-VolumesDeleteCascade-1765742457 None] Created volume successfully. Nov 03 13:09:48 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Acquiring lock "cinder-d438928d-dc29-4950-8d7c-3fa1162a7ef1-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:48 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Lock "cinder-d438928d-dc29-4950-8d7c-3fa1162a7ef1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:48 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Performing cascade delete. {{(pid=86725) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 03 13:09:48 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Acquiring lock "cinder-e37afb78-86df-414f-b7cf-a2a6eba01765-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:48 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Lock "cinder-e37afb78-86df-414f-b7cf-a2a6eba01765-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:48 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Acquiring lock "cinder-quobyte-d438928d-dc29-4950-8d7c-3fa1162a7ef1" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:48 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Lock "cinder-quobyte-d438928d-dc29-4950-8d7c-3fa1162a7ef1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:48 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Acquiring lock "cinder-quobyte-e37afb78-86df-414f-b7cf-a2a6eba01765" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:48 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Lock "cinder-quobyte-e37afb78-86df-414f-b7cf-a2a6eba01765" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:48 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Deleting offline snapshot e37afb78-86df-414f-b7cf-a2a6eba01765 of volume d438928d-dc29-4950-8d7c-3fa1162a7ef1 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:09:48 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] snapshot_file for this snap is: volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1.e37afb78-86df-414f-b7cf-a2a6eba01765 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:09:48 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a4cd2f-3650-40cd-8b26-95b74cd6ffdf]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1.e37afb78-86df-414f-b7cf-a2a6eba01765 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:48 devstack sudo[91348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1.e37afb78-86df-414f-b7cf-a2a6eba01765 Nov 03 13:09:48 devstack sudo[91348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:49 devstack sudo[91348]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:49 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:09:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] Flow 'volume_create_manager' (7375c51f-36d4-4adc-882f-6f675bc3c98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:09:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef3fb191-34ab-4977-9fa8-94722775036a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1.e37afb78-86df-414f-b7cf-a2a6eba01765" returned: 0 in 0.617s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:09:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef3fb191-34ab-4977-9fa8-94722775036a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1751044366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e43372-bcb2-48e1-8bbd-ed20f965f6d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19794791f1e2414ba57edb38242a425d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:09:49Z,use_quota=True,user_id='43d0b310bf30429f9651d28912576de7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (180c0a00-b280-4566-bbe2-0c186939c2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (180c0a00-b280-4566-bbe2-0c186939c2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0f3b79-905e-402d-8cae-145f48fe2083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0f3b79-905e-402d-8cae-145f48fe2083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4e43372-bcb2-48e1-8bbd-ed20f965f6d3', 'volume_name': 'volume-c4e43372-bcb2-48e1-8bbd-ed20f965f6d3', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d246c30-4b1b-470b-9f19-1cb0becbc29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d246c30-4b1b-470b-9f19-1cb0becbc29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d8aa84-ed61-469f-af9c-3f2d6725b79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:49 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] Volume c4e43372-bcb2-48e1-8bbd-ed20f965f6d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4e43372-bcb2-48e1-8bbd-ed20f965f6d3', 'volume_size': 1} Nov 03 13:09:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1751044366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e43372-bcb2-48e1-8bbd-ed20f965f6d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19794791f1e2414ba57edb38242a425d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:09:49Z,use_quota=True,user_id='43d0b310bf30429f9651d28912576de7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:09:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] Creating volume c4e43372-bcb2-48e1-8bbd-ed20f965f6d3 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:09:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:09:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:09:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:09:49 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:09:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c4e43372-bcb2-48e1-8bbd-ed20f965f6d3 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:49 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf93aad-18dc-47f8-9751-8893c36b01eb]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:49 devstack sudo[91354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c4e43372-bcb2-48e1-8bbd-ed20f965f6d3 1073741824 Nov 03 13:09:49 devstack sudo[91354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:49 devstack sudo[91355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1 Nov 03 13:09:49 devstack sudo[91355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:50 devstack sudo[91354]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c4e43372-bcb2-48e1-8bbd-ed20f965f6d3 1073741824" returned: 0 in 0.542s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c4e43372-bcb2-48e1-8bbd-ed20f965f6d3 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:50 devstack sudo[91364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c4e43372-bcb2-48e1-8bbd-ed20f965f6d3 Nov 03 13:09:50 devstack sudo[91364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:50 devstack sudo[91355]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1" returned: 0 in 0.678s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1.e37afb78-86df-414f-b7cf-a2a6eba01765 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:50 devstack sudo[91367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1.e37afb78-86df-414f-b7cf-a2a6eba01765 Nov 03 13:09:50 devstack sudo[91367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:50 devstack sudo[91364]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c4e43372-bcb2-48e1-8bbd-ed20f965f6d3" returned: 0 in 0.343s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:09:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d8aa84-ed61-469f-af9c-3f2d6725b79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4e43372-bcb2-48e1-8bbd-ed20f965f6d3', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b23529c0-3f29-4718-82e5-bce0963ab9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:50 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] Volume volume-c4e43372-bcb2-48e1-8bbd-ed20f965f6d3 (c4e43372-bcb2-48e1-8bbd-ed20f965f6d3): created successfully Nov 03 13:09:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b23529c0-3f29-4718-82e5-bce0963ab9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] Flow 'volume_create_manager' (7375c51f-36d4-4adc-882f-6f675bc3c98d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:09:50 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-69a8753f-eeae-48cd-a323-97b6da5f7406 tempest-AttachVolumeNegativeTest-621359088 None] Created volume successfully. Nov 03 13:09:50 devstack sudo[91367]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1.e37afb78-86df-414f-b7cf-a2a6eba01765" returned: 0 in 0.467s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1.e37afb78-86df-414f-b7cf-a2a6eba01765 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:50 devstack sudo[91374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1.e37afb78-86df-414f-b7cf-a2a6eba01765 Nov 03 13:09:50 devstack sudo[91374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:51 devstack sudo[91374]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1.e37afb78-86df-414f-b7cf-a2a6eba01765" returned: 0 in 0.436s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Lock "cinder-quobyte-e37afb78-86df-414f-b7cf-a2a6eba01765" released by "_delete_snapshot" :: held 2.401s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Lock "cinder-quobyte-d438928d-dc29-4950-8d7c-3fa1162a7ef1" released by "delete_snapshot" :: held 2.431s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:51 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Created reservations ['6d57f4c4-d7c0-4e7e-803a-dfafc73b5935', 'e4b006f9-265a-41b8-b48c-13c09a690057', '755ed4c9-93ed-4ecf-8693-a58322ca1642', 'de32a903-d7fa-4ec9-b08f-d9bc32490688'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:09:51 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Delete snapshot completed successfully. Nov 03 13:09:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Lock "cinder-e37afb78-86df-414f-b7cf-a2a6eba01765-delete_snapshot" released by "delete_snapshot" :: held 2.607s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Snapshots deleted, issuing volume delete {{(pid=86725) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 03 13:09:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Acquiring lock "cinder-quobyte-d438928d-dc29-4950-8d7c-3fa1162a7ef1" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Lock "cinder-quobyte-d438928d-dc29-4950-8d7c-3fa1162a7ef1" acquired by "delete_volume" :: waited 0.015s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:51 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[220743ee-8a1d-453f-bd50-f212c91d0c91]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:51 devstack sudo[91380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1 Nov 03 13:09:51 devstack sudo[91380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:52 devstack sudo[91380]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1" returned: 0 in 0.644s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:52 devstack sudo[91391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1 Nov 03 13:09:52 devstack sudo[91391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:52 devstack sudo[91391]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d438928d-dc29-4950-8d7c-3fa1162a7ef1" returned: 0 in 0.363s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:52 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Lock "cinder-quobyte-d438928d-dc29-4950-8d7c-3fa1162a7ef1" released by "delete_volume" :: held 1.128s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:52 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Created reservations ['342ff15b-8bb3-4e53-98d3-4150379228eb', '0d727d84-9fa0-4c48-8102-3e63450c12c3', '10528cbd-dcef-48ef-a01f-3cabe8d5960c', '26d97a5a-7e3c-4ec1-9b1a-012c2e46448e'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:09:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-55a2e04e-4ba2-4b6a-9f2d-f79304fdef2f req-c26ee6bd-5953-4cb1-bbad-3207eecbf396 tempest-AttachVolumeNegativeTest-621359088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-55a2e04e-4ba2-4b6a-9f2d-f79304fdef2f req-c26ee6bd-5953-4cb1-bbad-3207eecbf396 tempest-AttachVolumeNegativeTest-621359088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-55a2e04e-4ba2-4b6a-9f2d-f79304fdef2f req-c26ee6bd-5953-4cb1-bbad-3207eecbf396 tempest-AttachVolumeNegativeTest-621359088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-55a2e04e-4ba2-4b6a-9f2d-f79304fdef2f req-c26ee6bd-5953-4cb1-bbad-3207eecbf396 tempest-AttachVolumeNegativeTest-621359088 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43', 'name': 'volume-c4e43372-bcb2-48e1-8bbd-ed20f965f6d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0213e9ff-518f-4e09-ba3d-326518c5033f', 'enforce_multipath': True} {{(pid=86725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:09:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:52 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:09:52 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:09:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:52 devstack sudo[91403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:09:52 devstack sudo[91403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:52 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-55a2e04e-4ba2-4b6a-9f2d-f79304fdef2f req-c26ee6bd-5953-4cb1-bbad-3207eecbf396 tempest-AttachVolumeNegativeTest-621359088 None] attachment_update completed successfully. Nov 03 13:09:53 devstack sudo[91403]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.413s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:53 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:09:53 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Deleted volume successfully. Nov 03 13:09:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a593e51b-da8b-411c-92f6-f0649b28776f tempest-VolumesDeleteCascade-1765742457 None] Lock "cinder-d438928d-dc29-4950-8d7c-3fa1162a7ef1-delete_volume" released by "delete_volume" :: held 4.528s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c92f6a59-50b8-46a7-9bc3-e78f68990f46 tempest-VolumesDeleteCascade-1765742457 None] Acquiring lock "cinder-fd16fab3-6fac-4853-9f77-73dba7db455d-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c92f6a59-50b8-46a7-9bc3-e78f68990f46 tempest-VolumesDeleteCascade-1765742457 None] Lock "cinder-fd16fab3-6fac-4853-9f77-73dba7db455d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c92f6a59-50b8-46a7-9bc3-e78f68990f46 tempest-VolumesDeleteCascade-1765742457 None] Acquiring lock "cinder-quobyte-fd16fab3-6fac-4853-9f77-73dba7db455d" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c92f6a59-50b8-46a7-9bc3-e78f68990f46 tempest-VolumesDeleteCascade-1765742457 None] Lock "cinder-quobyte-fd16fab3-6fac-4853-9f77-73dba7db455d" acquired by "delete_volume" :: waited 0.030s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:53 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[7945c827-2d5b-40d4-ab82-83f2fd16c6ac]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c92f6a59-50b8-46a7-9bc3-e78f68990f46 tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-fd16fab3-6fac-4853-9f77-73dba7db455d {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:53 devstack sudo[91832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-fd16fab3-6fac-4853-9f77-73dba7db455d Nov 03 13:09:53 devstack sudo[91832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:54 devstack sudo[91832]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c92f6a59-50b8-46a7-9bc3-e78f68990f46 tempest-VolumesDeleteCascade-1765742457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-fd16fab3-6fac-4853-9f77-73dba7db455d" returned: 0 in 0.522s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c92f6a59-50b8-46a7-9bc3-e78f68990f46 tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-fd16fab3-6fac-4853-9f77-73dba7db455d {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:54 devstack sudo[91843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-fd16fab3-6fac-4853-9f77-73dba7db455d Nov 03 13:09:54 devstack sudo[91843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:54 devstack sudo[91843]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c92f6a59-50b8-46a7-9bc3-e78f68990f46 tempest-VolumesDeleteCascade-1765742457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-fd16fab3-6fac-4853-9f77-73dba7db455d" returned: 0 in 0.356s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:54 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c92f6a59-50b8-46a7-9bc3-e78f68990f46 tempest-VolumesDeleteCascade-1765742457 None] Lock "cinder-quobyte-fd16fab3-6fac-4853-9f77-73dba7db455d" released by "delete_volume" :: held 0.951s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:54 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-c92f6a59-50b8-46a7-9bc3-e78f68990f46 tempest-VolumesDeleteCascade-1765742457 None] Created reservations ['600572e5-2946-4153-a467-bb7940f6d9b7', 'f5f5a222-1bdd-4c3c-978b-e77935cdfb9a', 'd3917c8f-d465-4e31-8ff4-2fe221b8aa25', 'cdcd1216-750c-4175-a028-61e6546ccc32'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:09:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c92f6a59-50b8-46a7-9bc3-e78f68990f46 tempest-VolumesDeleteCascade-1765742457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c92f6a59-50b8-46a7-9bc3-e78f68990f46 tempest-VolumesDeleteCascade-1765742457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:54 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-c92f6a59-50b8-46a7-9bc3-e78f68990f46 tempest-VolumesDeleteCascade-1765742457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:09:54 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-c92f6a59-50b8-46a7-9bc3-e78f68990f46 tempest-VolumesDeleteCascade-1765742457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:09:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c92f6a59-50b8-46a7-9bc3-e78f68990f46 tempest-VolumesDeleteCascade-1765742457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c92f6a59-50b8-46a7-9bc3-e78f68990f46 tempest-VolumesDeleteCascade-1765742457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:54 devstack sudo[91852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:09:54 devstack sudo[91852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:55 devstack sudo[91852]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c92f6a59-50b8-46a7-9bc3-e78f68990f46 tempest-VolumesDeleteCascade-1765742457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.305s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:55 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-c92f6a59-50b8-46a7-9bc3-e78f68990f46 tempest-VolumesDeleteCascade-1765742457 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:09:55 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-c92f6a59-50b8-46a7-9bc3-e78f68990f46 tempest-VolumesDeleteCascade-1765742457 None] Deleted volume successfully. Nov 03 13:09:55 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c92f6a59-50b8-46a7-9bc3-e78f68990f46 tempest-VolumesDeleteCascade-1765742457 None] Lock "cinder-fd16fab3-6fac-4853-9f77-73dba7db455d-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:58 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:09:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:09:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:09:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:58 devstack sudo[91930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:09:58 devstack sudo[91930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:59 devstack sudo[91930]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.544s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:59 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:09:59 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager._thread_info {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:09:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread count: 8 {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:09:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread info: [<_MainThread(MainThread, started 133507074375808)>, , , , , , , ] {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:10:04 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=29,cinder:UPDATE=33,cinder:INSERT=7 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:10:05 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:UPDATE=24,cinder:INSERT=7,cinder:SELECT=22,cinder:DELETE=4 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:10:24 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:10:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] Flow 'volume_create_manager' (3166e11b-0f92-4aab-a4a0-89143e38c17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:10:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bd612e4-9a07-4e44-91a3-3e976f2a9e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bd612e4-9a07-4e44-91a3-3e976f2a9e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1650964770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a79be6dc-5462-4a10-89c8-3873b4b51490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac0ef013acd242349b2271c9943b1a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:10:24Z,use_quota=True,user_id='0f473420810e413e9261030d36c51a5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ab002e-ac40-44d2-8842-4f9fb412d6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ab002e-ac40-44d2-8842-4f9fb412d6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d63dda2d-24db-4cd4-8af7-2bff7c35b410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d63dda2d-24db-4cd4-8af7-2bff7c35b410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a79be6dc-5462-4a10-89c8-3873b4b51490', 'volume_name': 'volume-a79be6dc-5462-4a10-89c8-3873b4b51490', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd8c4011-0e0a-401f-84ff-b88c6d0931ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd8c4011-0e0a-401f-84ff-b88c6d0931ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (855374b9-7046-459d-b2db-c422d4c6ab74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:24 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] Volume a79be6dc-5462-4a10-89c8-3873b4b51490: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a79be6dc-5462-4a10-89c8-3873b4b51490', 'volume_size': 1} Nov 03 13:10:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:24 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1650964770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a79be6dc-5462-4a10-89c8-3873b4b51490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac0ef013acd242349b2271c9943b1a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:10:24Z,use_quota=True,user_id='0f473420810e413e9261030d36c51a5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:10:24 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] Creating volume a79be6dc-5462-4a10-89c8-3873b4b51490 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:10:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:24 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:10:24 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:10:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:24 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:10:24 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:10:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:24 devstack sudo[92175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490 1073741824 Nov 03 13:10:24 devstack sudo[92175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:24 devstack sudo[92175]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490 1073741824" returned: 0 in 0.454s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:24 devstack sudo[92183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490 Nov 03 13:10:24 devstack sudo[92183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:25 devstack sudo[92183]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490" returned: 0 in 0.424s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:10:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (855374b9-7046-459d-b2db-c422d4c6ab74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a79be6dc-5462-4a10-89c8-3873b4b51490', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f521beba-bcde-49a4-b92b-e8b31cbad5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:25 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] Volume volume-a79be6dc-5462-4a10-89c8-3873b4b51490 (a79be6dc-5462-4a10-89c8-3873b4b51490): created successfully Nov 03 13:10:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f521beba-bcde-49a4-b92b-e8b31cbad5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] Flow 'volume_create_manager' (3166e11b-0f92-4aab-a4a0-89143e38c17b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:10:25 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-22fc40fa-f033-4c12-b8d3-53783931f832 tempest-VolumesActionsTest-1062688026 None] Created volume successfully. Nov 03 13:10:25 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:10:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] Flow 'volume_create_manager' (e3551332-a149-4d73-b6f3-958b451b58a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:10:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2a783b3-cc24-4936-a51d-82e95a30768c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2a783b3-cc24-4936-a51d-82e95a30768c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1207048103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45fe9d66-94b9-4f5c-a6a1-9942d7b616c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c06621f542c499ab0b94a2623f03850',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:10:25Z,use_quota=True,user_id='75aedde209454b70b36a89b2259f54b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (952278f8-0a6e-42e9-a1ba-9d4451a4c4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (952278f8-0a6e-42e9-a1ba-9d4451a4c4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34f93995-19e7-414c-af8f-842a166f8906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34f93995-19e7-414c-af8f-842a166f8906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45fe9d66-94b9-4f5c-a6a1-9942d7b616c7', 'volume_name': 'volume-45fe9d66-94b9-4f5c-a6a1-9942d7b616c7', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d16375-5336-46b1-952a-164738d7fa12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d16375-5336-46b1-952a-164738d7fa12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (140b8213-b2ab-4d9b-9589-2cc4da74d05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:25 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] Volume 45fe9d66-94b9-4f5c-a6a1-9942d7b616c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45fe9d66-94b9-4f5c-a6a1-9942d7b616c7', 'volume_size': 1} Nov 03 13:10:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1207048103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45fe9d66-94b9-4f5c-a6a1-9942d7b616c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c06621f542c499ab0b94a2623f03850',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:10:25Z,use_quota=True,user_id='75aedde209454b70b36a89b2259f54b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:10:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] Creating volume 45fe9d66-94b9-4f5c-a6a1-9942d7b616c7 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:10:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:10:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:10:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:10:25 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:10:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-45fe9d66-94b9-4f5c-a6a1-9942d7b616c7 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:25 devstack sudo[92213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-45fe9d66-94b9-4f5c-a6a1-9942d7b616c7 1073741824 Nov 03 13:10:25 devstack sudo[92213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:26 devstack sudo[92213]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-45fe9d66-94b9-4f5c-a6a1-9942d7b616c7 1073741824" returned: 0 in 0.425s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-45fe9d66-94b9-4f5c-a6a1-9942d7b616c7 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:26 devstack sudo[92218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-45fe9d66-94b9-4f5c-a6a1-9942d7b616c7 Nov 03 13:10:26 devstack sudo[92218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:26 devstack sudo[92218]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-45fe9d66-94b9-4f5c-a6a1-9942d7b616c7" returned: 0 in 0.278s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:10:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (140b8213-b2ab-4d9b-9589-2cc4da74d05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45fe9d66-94b9-4f5c-a6a1-9942d7b616c7', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (000d7c71-2c8e-48ca-9cb5-e164cf10d5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:26 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] Volume volume-45fe9d66-94b9-4f5c-a6a1-9942d7b616c7 (45fe9d66-94b9-4f5c-a6a1-9942d7b616c7): created successfully Nov 03 13:10:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (000d7c71-2c8e-48ca-9cb5-e164cf10d5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] Flow 'volume_create_manager' (e3551332-a149-4d73-b6f3-958b451b58a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:10:26 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-1a4d6839-c47b-498f-ab67-ae27b4737088 tempest-AttachVolumeTestJSON-2041145724 None] Created volume successfully. Nov 03 13:10:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-cb87a746-2701-4166-a25e-d61a307541c7 req-ab36069a-d7a7-47d3-bc57-f3bee39e5374 tempest-AttachVolumeTestJSON-2041145724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-cb87a746-2701-4166-a25e-d61a307541c7 req-ab36069a-d7a7-47d3-bc57-f3bee39e5374 tempest-AttachVolumeTestJSON-2041145724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-cb87a746-2701-4166-a25e-d61a307541c7 req-ab36069a-d7a7-47d3-bc57-f3bee39e5374 tempest-AttachVolumeTestJSON-2041145724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-cb87a746-2701-4166-a25e-d61a307541c7 req-ab36069a-d7a7-47d3-bc57-f3bee39e5374 tempest-AttachVolumeTestJSON-2041145724 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43', 'name': 'volume-45fe9d66-94b9-4f5c-a6a1-9942d7b616c7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd4f75a93-2834-4c94-baa3-b2f1bea4f94e', 'enforce_multipath': True} {{(pid=86725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:10:28 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-cb87a746-2701-4166-a25e-d61a307541c7 req-ab36069a-d7a7-47d3-bc57-f3bee39e5374 tempest-AttachVolumeTestJSON-2041145724 None] attachment_update completed successfully. Nov 03 13:10:31 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:10:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] Flow 'volume_create_manager' (eb0c0c7d-660a-4edc-b171-4c2bbcab6e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:10:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc827a1-314b-4c96-a284-ddb974215e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc827a1-314b-4c96-a284-ddb974215e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-275941425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66608529-75f0-4b10-85c9-d3e1bad5813b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c06621f542c499ab0b94a2623f03850',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:10:31Z,use_quota=True,user_id='75aedde209454b70b36a89b2259f54b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb304619-3e2e-49ee-952f-15c768cc826b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb304619-3e2e-49ee-952f-15c768cc826b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c018a3-ba44-48b8-ae24-863651e36c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c018a3-ba44-48b8-ae24-863651e36c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66608529-75f0-4b10-85c9-d3e1bad5813b', 'volume_name': 'volume-66608529-75f0-4b10-85c9-d3e1bad5813b', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63379cfd-42db-4d0d-ba9d-0aa37220f163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63379cfd-42db-4d0d-ba9d-0aa37220f163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0f7252f-4849-4254-978b-6af3030bb66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:31 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] Volume 66608529-75f0-4b10-85c9-d3e1bad5813b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66608529-75f0-4b10-85c9-d3e1bad5813b', 'volume_size': 1} Nov 03 13:10:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:31 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-275941425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66608529-75f0-4b10-85c9-d3e1bad5813b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c06621f542c499ab0b94a2623f03850',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:10:31Z,use_quota=True,user_id='75aedde209454b70b36a89b2259f54b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:10:31 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] Creating volume 66608529-75f0-4b10-85c9-d3e1bad5813b {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:10:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:31 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:10:31 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:10:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:31 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:10:31 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:10:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66608529-75f0-4b10-85c9-d3e1bad5813b 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:31 devstack sudo[92278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66608529-75f0-4b10-85c9-d3e1bad5813b 1073741824 Nov 03 13:10:31 devstack sudo[92278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:32 devstack sudo[92278]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66608529-75f0-4b10-85c9-d3e1bad5813b 1073741824" returned: 0 in 0.985s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66608529-75f0-4b10-85c9-d3e1bad5813b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:32 devstack sudo[92339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66608529-75f0-4b10-85c9-d3e1bad5813b Nov 03 13:10:32 devstack sudo[92339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:32 devstack sudo[92339]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66608529-75f0-4b10-85c9-d3e1bad5813b" returned: 0 in 0.552s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:32 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:10:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:32 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0f7252f-4849-4254-978b-6af3030bb66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66608529-75f0-4b10-85c9-d3e1bad5813b', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:32 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cba2480-8263-4826-8ec6-75ffab8aeff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:32 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] Volume volume-66608529-75f0-4b10-85c9-d3e1bad5813b (66608529-75f0-4b10-85c9-d3e1bad5813b): created successfully Nov 03 13:10:32 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cba2480-8263-4826-8ec6-75ffab8aeff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:32 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] Flow 'volume_create_manager' (eb0c0c7d-660a-4edc-b171-4c2bbcab6e35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:10:32 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-7aa5e48b-cc0e-4db8-8d84-319a8618e202 tempest-AttachVolumeTestJSON-2041145724 None] Created volume successfully. Nov 03 13:10:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-fe13f82c-48cc-415f-aff5-e5e09ff0e67d req-ba586ece-97e5-44d9-980b-6d1882228882 tempest-AttachVolumeTestJSON-2041145724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-fe13f82c-48cc-415f-aff5-e5e09ff0e67d req-ba586ece-97e5-44d9-980b-6d1882228882 tempest-AttachVolumeTestJSON-2041145724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-fe13f82c-48cc-415f-aff5-e5e09ff0e67d req-ba586ece-97e5-44d9-980b-6d1882228882 tempest-AttachVolumeTestJSON-2041145724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-fe13f82c-48cc-415f-aff5-e5e09ff0e67d req-ba586ece-97e5-44d9-980b-6d1882228882 tempest-AttachVolumeTestJSON-2041145724 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43', 'name': 'volume-66608529-75f0-4b10-85c9-d3e1bad5813b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '73e756f9-af65-44ab-ac93-12ddc31246da', 'enforce_multipath': True} {{(pid=86725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:10:34 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-fe13f82c-48cc-415f-aff5-e5e09ff0e67d req-ba586ece-97e5-44d9-980b-6d1882228882 tempest-AttachVolumeTestJSON-2041145724 None] attachment_update completed successfully. Nov 03 13:10:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b2d006d5-75de-4b7b-8611-fe0f22b7fad2 tempest-VolumesActionsTest-1062688026 None] Acquiring lock "cinder-a79be6dc-5462-4a10-89c8-3873b4b51490" by "attach_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:10:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b2d006d5-75de-4b7b-8611-fe0f22b7fad2 tempest-VolumesActionsTest-1062688026 None] Lock "cinder-a79be6dc-5462-4a10-89c8-3873b4b51490" acquired by "attach_volume" :: waited 0.026s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:10:35 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-b2d006d5-75de-4b7b-8611-fe0f22b7fad2 tempest-VolumesActionsTest-1062688026 None] Attaching volume a79be6dc-5462-4a10-89c8-3873b4b51490 to instance 396674bd-7c21-4b9b-89b5-f9eeed7767ca at mountpoint /dev/vdb on host None. Nov 03 13:10:35 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-b2d006d5-75de-4b7b-8611-fe0f22b7fad2 tempest-VolumesActionsTest-1062688026 None] Attach volume completed successfully. Nov 03 13:10:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b2d006d5-75de-4b7b-8611-fe0f22b7fad2 tempest-VolumesActionsTest-1062688026 None] Lock "cinder-a79be6dc-5462-4a10-89c8-3873b4b51490" released by "attach_volume" :: held 0.115s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:10:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-af705525-058d-49cf-84fb-ecd974ceba52 tempest-VolumesActionsTest-1062688026 None] Acquiring lock "cinder-a79be6dc-5462-4a10-89c8-3873b4b51490-detach_volume" by "detach_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:10:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-af705525-058d-49cf-84fb-ecd974ceba52 tempest-VolumesActionsTest-1062688026 None] Lock "cinder-a79be6dc-5462-4a10-89c8-3873b4b51490-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:10:35 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-af705525-058d-49cf-84fb-ecd974ceba52 tempest-VolumesActionsTest-1062688026 None] Detaching volume a79be6dc-5462-4a10-89c8-3873b4b51490 from instance 396674bd-7c21-4b9b-89b5-f9eeed7767ca. Nov 03 13:10:35 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-af705525-058d-49cf-84fb-ecd974ceba52 tempest-VolumesActionsTest-1062688026 None] Detach volume completed successfully. Nov 03 13:10:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-af705525-058d-49cf-84fb-ecd974ceba52 tempest-VolumesActionsTest-1062688026 None] Lock "cinder-a79be6dc-5462-4a10-89c8-3873b4b51490-detach_volume" released by "detach_volume" :: held 0.082s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:10:36 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-6324bf46-6820-488e-ae23-c30870d637f9 req-4ba5c391-a774-4fe7-a8a4-6d862e476927 tempest-AttachVolumeTestJSON-2041145724 None] Terminate volume connection completed successfully. Nov 03 13:10:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-6324bf46-6820-488e-ae23-c30870d637f9 req-4ba5c391-a774-4fe7-a8a4-6d862e476927 tempest-AttachVolumeTestJSON-2041145724 None] Deleting attachment d4f75a93-2834-4c94-baa3-b2f1bea4f94e. {{(pid=86725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:10:38 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:10:38 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] Flow 'volume_create_manager' (b399021d-b27a-4d4c-aa2c-67da69989161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:10:38 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb94439d-5998-4ca7-88b8-e6d6e7617ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:38 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb94439d-5998-4ca7-88b8-e6d6e7617ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2138087695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfbaad03-ad94-4aa4-9908-bed601c27244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54276b007b194d47801cbf0d874f385c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:10:38Z,use_quota=True,user_id='e523d0d2aecd4f749b0b079cf25f3a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:38 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fddcde8c-e9d8-4389-a30f-83cf00975ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:38 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fddcde8c-e9d8-4389-a30f-83cf00975ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:38 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c7610c4-eaf3-481c-aec5-49a575e03f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:38 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c7610c4-eaf3-481c-aec5-49a575e03f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfbaad03-ad94-4aa4-9908-bed601c27244', 'volume_name': 'volume-cfbaad03-ad94-4aa4-9908-bed601c27244', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:38 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f03e703-c20a-45d8-8814-8e2b91a183cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:38 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f03e703-c20a-45d8-8814-8e2b91a183cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:38 devstack sudo[92407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cfbaad03-ad94-4aa4-9908-bed601c27244 1073741824 Nov 03 13:10:38 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba8aad1d-e95a-4b76-843a-7d00cc760460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:38 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] Volume cfbaad03-ad94-4aa4-9908-bed601c27244: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfbaad03-ad94-4aa4-9908-bed601c27244', 'volume_size': 1} Nov 03 13:10:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:38 devstack sudo[92407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:38 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2138087695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfbaad03-ad94-4aa4-9908-bed601c27244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54276b007b194d47801cbf0d874f385c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:10:38Z,use_quota=True,user_id='e523d0d2aecd4f749b0b079cf25f3a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:10:38 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] Creating volume cfbaad03-ad94-4aa4-9908-bed601c27244 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:10:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:38 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:10:38 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:10:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:38 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:10:38 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:10:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cfbaad03-ad94-4aa4-9908-bed601c27244 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:38 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-ee144e3a-af6b-410f-b091-0a156b6237b7 req-5f922edf-43c6-4757-8c4d-f7099cfe997c tempest-AttachVolumeTestJSON-2041145724 None] Terminate volume connection completed successfully. Nov 03 13:10:38 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-ee144e3a-af6b-410f-b091-0a156b6237b7 req-5f922edf-43c6-4757-8c4d-f7099cfe997c tempest-AttachVolumeTestJSON-2041145724 None] Deleting attachment 73e756f9-af65-44ab-ac93-12ddc31246da. {{(pid=86725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:10:39 devstack sudo[92407]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cfbaad03-ad94-4aa4-9908-bed601c27244 1073741824" returned: 0 in 0.704s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cfbaad03-ad94-4aa4-9908-bed601c27244 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:39 devstack sudo[92415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cfbaad03-ad94-4aa4-9908-bed601c27244 Nov 03 13:10:39 devstack sudo[92415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:39 devstack sudo[92415]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cfbaad03-ad94-4aa4-9908-bed601c27244" returned: 0 in 0.310s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:39 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:10:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:39 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba8aad1d-e95a-4b76-843a-7d00cc760460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfbaad03-ad94-4aa4-9908-bed601c27244', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:39 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ba3af8c-e155-48d4-b7bb-71322f06414b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:39 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] Volume volume-cfbaad03-ad94-4aa4-9908-bed601c27244 (cfbaad03-ad94-4aa4-9908-bed601c27244): created successfully Nov 03 13:10:39 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ba3af8c-e155-48d4-b7bb-71322f06414b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:39 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] Flow 'volume_create_manager' (b399021d-b27a-4d4c-aa2c-67da69989161) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:10:39 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-54bca4c2-6a0b-4f21-bad4-25b9ed92d217 tempest-ServerActionsTestOtherA-2024956670 None] Created volume successfully. Nov 03 13:10:44 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-333625b5-81e1-4c11-bd15-aefd107d44ad tempest-AttachVolumeTestJSON-2041145724 None] Acquiring lock "cinder-66608529-75f0-4b10-85c9-d3e1bad5813b-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:10:44 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-333625b5-81e1-4c11-bd15-aefd107d44ad tempest-AttachVolumeTestJSON-2041145724 None] Lock "cinder-66608529-75f0-4b10-85c9-d3e1bad5813b-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:10:44 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-333625b5-81e1-4c11-bd15-aefd107d44ad tempest-AttachVolumeTestJSON-2041145724 None] Acquiring lock "cinder-quobyte-66608529-75f0-4b10-85c9-d3e1bad5813b" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:10:44 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-333625b5-81e1-4c11-bd15-aefd107d44ad tempest-AttachVolumeTestJSON-2041145724 None] Lock "cinder-quobyte-66608529-75f0-4b10-85c9-d3e1bad5813b" acquired by "delete_volume" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:10:45 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[7356af57-fc09-4491-944e-bf1743da6be3]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:10:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-333625b5-81e1-4c11-bd15-aefd107d44ad tempest-AttachVolumeTestJSON-2041145724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66608529-75f0-4b10-85c9-d3e1bad5813b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:45 devstack sudo[92510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66608529-75f0-4b10-85c9-d3e1bad5813b Nov 03 13:10:45 devstack sudo[92510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:45 devstack sudo[92510]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-333625b5-81e1-4c11-bd15-aefd107d44ad tempest-AttachVolumeTestJSON-2041145724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66608529-75f0-4b10-85c9-d3e1bad5813b" returned: 0 in 0.580s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-333625b5-81e1-4c11-bd15-aefd107d44ad tempest-AttachVolumeTestJSON-2041145724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66608529-75f0-4b10-85c9-d3e1bad5813b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:45 devstack sudo[92523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66608529-75f0-4b10-85c9-d3e1bad5813b Nov 03 13:10:45 devstack sudo[92523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:45 devstack sudo[92523]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-333625b5-81e1-4c11-bd15-aefd107d44ad tempest-AttachVolumeTestJSON-2041145724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66608529-75f0-4b10-85c9-d3e1bad5813b" returned: 0 in 0.382s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-333625b5-81e1-4c11-bd15-aefd107d44ad tempest-AttachVolumeTestJSON-2041145724 None] Lock "cinder-quobyte-66608529-75f0-4b10-85c9-d3e1bad5813b" released by "delete_volume" :: held 1.063s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:10:46 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-333625b5-81e1-4c11-bd15-aefd107d44ad tempest-AttachVolumeTestJSON-2041145724 None] Created reservations ['e0117d6a-f91d-4a11-923e-3865f8d8d08f', '80d76b57-5612-4463-ab12-fb4594c4017b', '09157ccd-572f-4dc7-b492-4d0d83836588', 'cd17aacf-6337-46ee-b2fd-21d0819c5853'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:10:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-333625b5-81e1-4c11-bd15-aefd107d44ad tempest-AttachVolumeTestJSON-2041145724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-333625b5-81e1-4c11-bd15-aefd107d44ad tempest-AttachVolumeTestJSON-2041145724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:46 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-333625b5-81e1-4c11-bd15-aefd107d44ad tempest-AttachVolumeTestJSON-2041145724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:10:46 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-333625b5-81e1-4c11-bd15-aefd107d44ad tempest-AttachVolumeTestJSON-2041145724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:10:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-333625b5-81e1-4c11-bd15-aefd107d44ad tempest-AttachVolumeTestJSON-2041145724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-333625b5-81e1-4c11-bd15-aefd107d44ad tempest-AttachVolumeTestJSON-2041145724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:46 devstack sudo[92538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:10:46 devstack sudo[92538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:46 devstack sudo[92538]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-333625b5-81e1-4c11-bd15-aefd107d44ad tempest-AttachVolumeTestJSON-2041145724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.341s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:46 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-333625b5-81e1-4c11-bd15-aefd107d44ad tempest-AttachVolumeTestJSON-2041145724 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:10:46 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-333625b5-81e1-4c11-bd15-aefd107d44ad tempest-AttachVolumeTestJSON-2041145724 None] Deleted volume successfully. Nov 03 13:10:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-333625b5-81e1-4c11-bd15-aefd107d44ad tempest-AttachVolumeTestJSON-2041145724 None] Lock "cinder-66608529-75f0-4b10-85c9-d3e1bad5813b-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:10:47 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1bd1c87e-5623-4a0f-839c-647d43bb53de tempest-AttachVolumeTestJSON-2041145724 None] Acquiring lock "cinder-45fe9d66-94b9-4f5c-a6a1-9942d7b616c7-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:10:47 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1bd1c87e-5623-4a0f-839c-647d43bb53de tempest-AttachVolumeTestJSON-2041145724 None] Lock "cinder-45fe9d66-94b9-4f5c-a6a1-9942d7b616c7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:10:47 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1bd1c87e-5623-4a0f-839c-647d43bb53de tempest-AttachVolumeTestJSON-2041145724 None] Acquiring lock "cinder-quobyte-45fe9d66-94b9-4f5c-a6a1-9942d7b616c7" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:10:47 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1bd1c87e-5623-4a0f-839c-647d43bb53de tempest-AttachVolumeTestJSON-2041145724 None] Lock "cinder-quobyte-45fe9d66-94b9-4f5c-a6a1-9942d7b616c7" acquired by "delete_volume" :: waited 0.028s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:10:47 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5ad65c-2185-4fc2-a233-992d312d7cdf]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:10:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1bd1c87e-5623-4a0f-839c-647d43bb53de tempest-AttachVolumeTestJSON-2041145724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-45fe9d66-94b9-4f5c-a6a1-9942d7b616c7 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:47 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-39321c43-3c5d-47ce-a69a-d5baa40912d4 req-5872d09d-1f61-40ab-8f3d-3e62e88d1d8d tempest-AttachVolumeNegativeTest-621359088 None] Terminate volume connection completed successfully. Nov 03 13:10:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-39321c43-3c5d-47ce-a69a-d5baa40912d4 req-5872d09d-1f61-40ab-8f3d-3e62e88d1d8d tempest-AttachVolumeNegativeTest-621359088 None] Deleting attachment 0213e9ff-518f-4e09-ba3d-326518c5033f. {{(pid=86725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:10:47 devstack sudo[92559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-45fe9d66-94b9-4f5c-a6a1-9942d7b616c7 Nov 03 13:10:47 devstack sudo[92559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:47 devstack sudo[92559]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1bd1c87e-5623-4a0f-839c-647d43bb53de tempest-AttachVolumeTestJSON-2041145724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-45fe9d66-94b9-4f5c-a6a1-9942d7b616c7" returned: 0 in 0.580s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1bd1c87e-5623-4a0f-839c-647d43bb53de tempest-AttachVolumeTestJSON-2041145724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-45fe9d66-94b9-4f5c-a6a1-9942d7b616c7 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:47 devstack sudo[92567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-45fe9d66-94b9-4f5c-a6a1-9942d7b616c7 Nov 03 13:10:47 devstack sudo[92567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:48 devstack sudo[92567]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1bd1c87e-5623-4a0f-839c-647d43bb53de tempest-AttachVolumeTestJSON-2041145724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-45fe9d66-94b9-4f5c-a6a1-9942d7b616c7" returned: 0 in 0.293s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:48 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1bd1c87e-5623-4a0f-839c-647d43bb53de tempest-AttachVolumeTestJSON-2041145724 None] Lock "cinder-quobyte-45fe9d66-94b9-4f5c-a6a1-9942d7b616c7" released by "delete_volume" :: held 0.938s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:10:48 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-1bd1c87e-5623-4a0f-839c-647d43bb53de tempest-AttachVolumeTestJSON-2041145724 None] Created reservations ['324dfc65-7c01-442a-a3ac-2bc81f5db0c0', 'b003fd6b-87e5-4692-bd43-f95426203c03', '52963c12-81a3-4973-85c2-e0fe0388ffa6', 'e6108727-737f-4661-b2b7-d7adc1c4bc13'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:10:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1bd1c87e-5623-4a0f-839c-647d43bb53de tempest-AttachVolumeTestJSON-2041145724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1bd1c87e-5623-4a0f-839c-647d43bb53de tempest-AttachVolumeTestJSON-2041145724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:48 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1bd1c87e-5623-4a0f-839c-647d43bb53de tempest-AttachVolumeTestJSON-2041145724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:10:48 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1bd1c87e-5623-4a0f-839c-647d43bb53de tempest-AttachVolumeTestJSON-2041145724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:10:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1bd1c87e-5623-4a0f-839c-647d43bb53de tempest-AttachVolumeTestJSON-2041145724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1bd1c87e-5623-4a0f-839c-647d43bb53de tempest-AttachVolumeTestJSON-2041145724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:48 devstack sudo[92571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:10:48 devstack sudo[92571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:48 devstack sudo[92571]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1bd1c87e-5623-4a0f-839c-647d43bb53de tempest-AttachVolumeTestJSON-2041145724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.467s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:48 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-1bd1c87e-5623-4a0f-839c-647d43bb53de tempest-AttachVolumeTestJSON-2041145724 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:10:48 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-1bd1c87e-5623-4a0f-839c-647d43bb53de tempest-AttachVolumeTestJSON-2041145724 None] Deleted volume successfully. Nov 03 13:10:48 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1bd1c87e-5623-4a0f-839c-647d43bb53de tempest-AttachVolumeTestJSON-2041145724 None] Lock "cinder-45fe9d66-94b9-4f5c-a6a1-9942d7b616c7-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:10:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-64b4cd90-c269-494d-844e-fec6dd884dce tempest-AttachVolumeTestJSON-2041145724 None] Acquiring lock "cinder-aada1f55-1d1a-49ce-b8ed-9a1b34d9e74f-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:10:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-64b4cd90-c269-494d-844e-fec6dd884dce tempest-AttachVolumeTestJSON-2041145724 None] Lock "cinder-aada1f55-1d1a-49ce-b8ed-9a1b34d9e74f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:10:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-64b4cd90-c269-494d-844e-fec6dd884dce tempest-AttachVolumeTestJSON-2041145724 None] Acquiring lock "cinder-quobyte-aada1f55-1d1a-49ce-b8ed-9a1b34d9e74f" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:10:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-64b4cd90-c269-494d-844e-fec6dd884dce tempest-AttachVolumeTestJSON-2041145724 None] Lock "cinder-quobyte-aada1f55-1d1a-49ce-b8ed-9a1b34d9e74f" acquired by "delete_volume" :: waited 0.029s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:10:50 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65f2ea8-c11f-4521-9b47-28f25c4d9bb9]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:10:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-64b4cd90-c269-494d-844e-fec6dd884dce tempest-AttachVolumeTestJSON-2041145724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aada1f55-1d1a-49ce-b8ed-9a1b34d9e74f {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:50 devstack sudo[92660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aada1f55-1d1a-49ce-b8ed-9a1b34d9e74f Nov 03 13:10:50 devstack sudo[92660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:51 devstack sudo[92660]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-64b4cd90-c269-494d-844e-fec6dd884dce tempest-AttachVolumeTestJSON-2041145724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aada1f55-1d1a-49ce-b8ed-9a1b34d9e74f" returned: 0 in 0.802s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-64b4cd90-c269-494d-844e-fec6dd884dce tempest-AttachVolumeTestJSON-2041145724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aada1f55-1d1a-49ce-b8ed-9a1b34d9e74f {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:51 devstack sudo[92668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aada1f55-1d1a-49ce-b8ed-9a1b34d9e74f Nov 03 13:10:51 devstack sudo[92668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:51 devstack sudo[92668]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-64b4cd90-c269-494d-844e-fec6dd884dce tempest-AttachVolumeTestJSON-2041145724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aada1f55-1d1a-49ce-b8ed-9a1b34d9e74f" returned: 0 in 0.441s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-64b4cd90-c269-494d-844e-fec6dd884dce tempest-AttachVolumeTestJSON-2041145724 None] Lock "cinder-quobyte-aada1f55-1d1a-49ce-b8ed-9a1b34d9e74f" released by "delete_volume" :: held 1.324s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:10:51 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-64b4cd90-c269-494d-844e-fec6dd884dce tempest-AttachVolumeTestJSON-2041145724 None] Created reservations ['a932a8e0-5d55-4caf-a901-f001c8ff7bef', 'aa4b48de-936d-4380-9729-065a7ffd9aba', 'bdec45c1-128b-4f2c-8750-d60f5a54304e', 'f5f577d6-622a-455a-8c1c-2c0e0452133d'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:10:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-64b4cd90-c269-494d-844e-fec6dd884dce tempest-AttachVolumeTestJSON-2041145724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-64b4cd90-c269-494d-844e-fec6dd884dce tempest-AttachVolumeTestJSON-2041145724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:52 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-64b4cd90-c269-494d-844e-fec6dd884dce tempest-AttachVolumeTestJSON-2041145724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:10:52 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-64b4cd90-c269-494d-844e-fec6dd884dce tempest-AttachVolumeTestJSON-2041145724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:10:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-64b4cd90-c269-494d-844e-fec6dd884dce tempest-AttachVolumeTestJSON-2041145724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-64b4cd90-c269-494d-844e-fec6dd884dce tempest-AttachVolumeTestJSON-2041145724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:52 devstack sudo[92672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:10:52 devstack sudo[92672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:52 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-61983715-edbe-42af-a891-c38f9f8dc4fa tempest-VolumesActionsTest-1062688026 None] Acquiring lock "cinder-a79be6dc-5462-4a10-89c8-3873b4b51490" by "attach_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:10:52 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-61983715-edbe-42af-a891-c38f9f8dc4fa tempest-VolumesActionsTest-1062688026 None] Lock "cinder-a79be6dc-5462-4a10-89c8-3873b4b51490" acquired by "attach_volume" :: waited 0.068s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:10:52 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-61983715-edbe-42af-a891-c38f9f8dc4fa tempest-VolumesActionsTest-1062688026 None] Attaching volume a79be6dc-5462-4a10-89c8-3873b4b51490 to instance f3e45f66-d3d4-4d21-af7d-6f87ca1b976a at mountpoint /dev/vdb on host None. Nov 03 13:10:52 devstack sudo[92672]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-64b4cd90-c269-494d-844e-fec6dd884dce tempest-AttachVolumeTestJSON-2041145724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.675s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:52 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-64b4cd90-c269-494d-844e-fec6dd884dce tempest-AttachVolumeTestJSON-2041145724 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:10:52 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-64b4cd90-c269-494d-844e-fec6dd884dce tempest-AttachVolumeTestJSON-2041145724 None] Deleted volume successfully. Nov 03 13:10:52 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-61983715-edbe-42af-a891-c38f9f8dc4fa tempest-VolumesActionsTest-1062688026 None] Attach volume completed successfully. Nov 03 13:10:52 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-61983715-edbe-42af-a891-c38f9f8dc4fa tempest-VolumesActionsTest-1062688026 None] Lock "cinder-a79be6dc-5462-4a10-89c8-3873b4b51490" released by "attach_volume" :: held 0.495s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:10:52 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-64b4cd90-c269-494d-844e-fec6dd884dce tempest-AttachVolumeTestJSON-2041145724 None] Lock "cinder-aada1f55-1d1a-49ce-b8ed-9a1b34d9e74f-delete_volume" released by "delete_volume" :: held 2.473s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:10:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-42e8adc3-1256-47b9-84b3-afe28d43c4bb tempest-VolumesActionsTest-1062688026 None] Acquiring lock "cinder-a79be6dc-5462-4a10-89c8-3873b4b51490-detach_volume" by "detach_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:10:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-42e8adc3-1256-47b9-84b3-afe28d43c4bb tempest-VolumesActionsTest-1062688026 None] Lock "cinder-a79be6dc-5462-4a10-89c8-3873b4b51490-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:10:53 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-42e8adc3-1256-47b9-84b3-afe28d43c4bb tempest-VolumesActionsTest-1062688026 None] Detaching volume a79be6dc-5462-4a10-89c8-3873b4b51490 from instance f3e45f66-d3d4-4d21-af7d-6f87ca1b976a. Nov 03 13:10:53 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-42e8adc3-1256-47b9-84b3-afe28d43c4bb tempest-VolumesActionsTest-1062688026 None] Detach volume completed successfully. Nov 03 13:10:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-42e8adc3-1256-47b9-84b3-afe28d43c4bb tempest-VolumesActionsTest-1062688026 None] Lock "cinder-a79be6dc-5462-4a10-89c8-3873b4b51490-detach_volume" released by "detach_volume" :: held 0.104s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:10:58 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:10:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:10:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:10:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:58 devstack sudo[92747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:10:58 devstack sudo[92747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:59 devstack sudo[92747]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.633s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:59 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:10:59 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager._thread_info {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:10:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread count: 8 {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:10:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread info: [<_MainThread(MainThread, started 133507074375808)>, , , , , , , ] {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:11:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d5242e3a-404b-43f3-814b-eaecf7129e25 tempest-VolumesActionsTest-1062688026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:11:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d5242e3a-404b-43f3-814b-eaecf7129e25 tempest-VolumesActionsTest-1062688026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:11:02 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a762ea1-4d10-477b-9146-1c2844dee370]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:11:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d5242e3a-404b-43f3-814b-eaecf7129e25 tempest-VolumesActionsTest-1062688026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:02 devstack sudo[92753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490 Nov 03 13:11:02 devstack sudo[92753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:03 devstack sudo[92753]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d5242e3a-404b-43f3-814b-eaecf7129e25 tempest-VolumesActionsTest-1062688026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490" returned: 0 in 0.598s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:03 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d1c468-1244-4285-ae9a-89d8a5a9dc5e]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:11:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d5242e3a-404b-43f3-814b-eaecf7129e25 tempest-VolumesActionsTest-1062688026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:03 devstack sudo[92758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490 Nov 03 13:11:03 devstack sudo[92758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:03 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=57,cinder:UPDATE=44,cinder:INSERT=9,cinder:DELETE=4 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:11:03 devstack sudo[92758]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d5242e3a-404b-43f3-814b-eaecf7129e25 tempest-VolumesActionsTest-1062688026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490" returned: 0 in 0.549s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d5242e3a-404b-43f3-814b-eaecf7129e25 tempest-VolumesActionsTest-1062688026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490 /opt/stack/data/cinder/conversion/a79be6dc-5462-4a10-89c8-3873b4b51490.temp_image.2fc8c85b-bd83-4085-9ae5-4fcd0441f2fchvf6hulj.img {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:03 devstack sudo[92766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490 /opt/stack/data/cinder/conversion/a79be6dc-5462-4a10-89c8-3873b4b51490.temp_image.2fc8c85b-bd83-4085-9ae5-4fcd0441f2fchvf6hulj.img Nov 03 13:11:03 devstack sudo[92766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:09 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-75d8907d-8924-4c99-bc42-75ddb9faf1b8 tempest-GroupsTest-1987018071 None] Group tempest-Group1-1833805158: creating Nov 03 13:11:09 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-75d8907d-8924-4c99-bc42-75ddb9faf1b8 tempest-GroupsTest-1987018071 None] Group tempest-Group1-1833805158: created successfully Nov 03 13:11:09 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-75d8907d-8924-4c99-bc42-75ddb9faf1b8 tempest-GroupsTest-1987018071 None] Create group completed successfully. Nov 03 13:11:10 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-d214120b-724f-41b1-a908-889a0f4c815b tempest-GroupsTest-1987018071 None] Group tempest-Group2-126004113: creating Nov 03 13:11:11 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-d214120b-724f-41b1-a908-889a0f4c815b tempest-GroupsTest-1987018071 None] Group tempest-Group2-126004113: created successfully Nov 03 13:11:11 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-d214120b-724f-41b1-a908-889a0f4c815b tempest-GroupsTest-1987018071 None] Create group completed successfully. Nov 03 13:11:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d5242e3a-404b-43f3-814b-eaecf7129e25 tempest-VolumesActionsTest-1062688026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490 /opt/stack/data/cinder/conversion/a79be6dc-5462-4a10-89c8-3873b4b51490.temp_image.2fc8c85b-bd83-4085-9ae5-4fcd0441f2fchvf6hulj.img" returned: 0 in 9.265s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:13 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67d9a80-a6db-48c3-bbf4-71f3a7ee1208]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:11:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d5242e3a-404b-43f3-814b-eaecf7129e25 tempest-VolumesActionsTest-1062688026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:13 devstack sudo[92816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490 Nov 03 13:11:13 devstack sudo[92816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:13 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:11:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] Flow 'volume_create_manager' (328ff81d-af53-4f88-ac62-671ea7c75662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:11:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6bc2111-3b90-48a7-9227-89a0daade4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:11:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6bc2111-3b90-48a7-9227-89a0daade4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-738550118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fc123a53-ca12-480a-8f5d-fa32b0083ad3,host='devstack@QuobyteHD#QuobyteHD',id=3a31a9c5-103e-4495-933b-b13320d643e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da49f5ba07b849fdaa676180762e91e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:11:13Z,use_quota=True,user_id='718c6ea7f44c427c82e05396dd4d8f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(80b2dfa1-dd21-49f6-a80b-400a743eed85),volume_type_id=80b2dfa1-dd21-49f6-a80b-400a743eed85)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:11:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a28e0f44-1d74-4583-8c9b-eae4b5392ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:11:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a28e0f44-1d74-4583-8c9b-eae4b5392ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:11:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (014b4e0b-9b5c-4b76-83f1-44125b27a4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:11:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (014b4e0b-9b5c-4b76-83f1-44125b27a4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a31a9c5-103e-4495-933b-b13320d643e4', 'volume_name': 'volume-3a31a9c5-103e-4495-933b-b13320d643e4', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:11:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db0f8936-d8b8-40f4-96f6-940da5f2b7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:11:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db0f8936-d8b8-40f4-96f6-940da5f2b7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:11:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fd2bcdf-67f8-4518-b86e-02d7f71a5050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:11:13 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] Volume 3a31a9c5-103e-4495-933b-b13320d643e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a31a9c5-103e-4495-933b-b13320d643e4', 'volume_size': 1} Nov 03 13:11:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:11:13 devstack sudo[92816]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d5242e3a-404b-43f3-814b-eaecf7129e25 tempest-VolumesActionsTest-1062688026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490" returned: 0 in 0.832s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:13 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-d5242e3a-404b-43f3-814b-eaecf7129e25 tempest-VolumesActionsTest-1062688026 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490, size 1024.00 MB, duration 9.27 sec, destination /opt/stack/data/cinder/conversion/a79be6dc-5462-4a10-89c8-3873b4b51490.temp_image.2fc8c85b-bd83-4085-9ae5-4fcd0441f2fchvf6hulj.img {{(pid=86725) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:11:13 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-d5242e3a-404b-43f3-814b-eaecf7129e25 tempest-VolumesActionsTest-1062688026 None] Converted 1024.00 MB image at 110.51 MB/s Nov 03 13:11:13 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-d5242e3a-404b-43f3-814b-eaecf7129e25 tempest-VolumesActionsTest-1062688026 None] 2fc8c85b-bd83-4085-9ae5-4fcd0441f2fc was raw, no need to convert to raw {{(pid=86725) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 03 13:11:18 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:UPDATE=49,cinder:SELECT=54,cinder:DELETE=3,cinder:INSERT=11 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:11:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-ec9b79f0-018b-42b4-8acd-d50d1b08cd9b req-4a301ad7-223d-4a08-bd37-57371a9a67ed tempest-ServerActionsTestOtherA-2024956670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:11:32 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:11:32 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:UPDATE=1 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:11:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d5242e3a-404b-43f3-814b-eaecf7129e25 tempest-VolumesActionsTest-1062688026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.773s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:11:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d5242e3a-404b-43f3-814b-eaecf7129e25 tempest-VolumesActionsTest-1062688026 None] Uploaded volume to glance image-id: 2fc8c85b-bd83-4085-9ae5-4fcd0441f2fc. {{(pid=86725) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 13:11:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.787s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:11:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fc123a53-ca12-480a-8f5d-fa32b0083ad3,created_at=2026-11-03T12:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-738550118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fc123a53-ca12-480a-8f5d-fa32b0083ad3,host='devstack@QuobyteHD#QuobyteHD',id=3a31a9c5-103e-4495-933b-b13320d643e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da49f5ba07b849fdaa676180762e91e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:11:13Z,use_quota=True,user_id='718c6ea7f44c427c82e05396dd4d8f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(80b2dfa1-dd21-49f6-a80b-400a743eed85),volume_type_id=80b2dfa1-dd21-49f6-a80b-400a743eed85)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:11:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] Creating volume 3a31a9c5-103e-4495-933b-b13320d643e4 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:11:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:11:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:11:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:11:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:11:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:11:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:11:36 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:11:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3a31a9c5-103e-4495-933b-b13320d643e4 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:36 devstack sudo[92992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3a31a9c5-103e-4495-933b-b13320d643e4 1073741824 Nov 03 13:11:36 devstack sudo[92992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:36 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-d5242e3a-404b-43f3-814b-eaecf7129e25 tempest-VolumesActionsTest-1062688026 None] Copy volume to image completed successfully. Nov 03 13:11:36 devstack sudo[92992]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3a31a9c5-103e-4495-933b-b13320d643e4 1073741824" returned: 0 in 0.428s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3a31a9c5-103e-4495-933b-b13320d643e4 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:36 devstack sudo[92998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3a31a9c5-103e-4495-933b-b13320d643e4 Nov 03 13:11:36 devstack sudo[92998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:37 devstack sudo[92998]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3a31a9c5-103e-4495-933b-b13320d643e4" returned: 0 in 0.244s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:37 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:11:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:11:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-ec9b79f0-018b-42b4-8acd-d50d1b08cd9b req-4a301ad7-223d-4a08-bd37-57371a9a67ed tempest-ServerActionsTestOtherA-2024956670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 18.104s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:11:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fd2bcdf-67f8-4518-b86e-02d7f71a5050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a31a9c5-103e-4495-933b-b13320d643e4', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:11:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a78a0b88-111c-4e85-a750-570ccbafbba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:11:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-ec9b79f0-018b-42b4-8acd-d50d1b08cd9b req-4a301ad7-223d-4a08-bd37-57371a9a67ed tempest-ServerActionsTestOtherA-2024956670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:11:37 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] Volume volume-3a31a9c5-103e-4495-933b-b13320d643e4 (3a31a9c5-103e-4495-933b-b13320d643e4): created successfully Nov 03 13:11:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a78a0b88-111c-4e85-a750-570ccbafbba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:11:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] Flow 'volume_create_manager' (328ff81d-af53-4f88-ac62-671ea7c75662) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:11:37 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-f55addc7-70ed-4a6d-b4c2-9c2874968afd tempest-GroupsTest-1987018071 None] Created volume successfully. Nov 03 13:11:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-ec9b79f0-018b-42b4-8acd-d50d1b08cd9b req-4a301ad7-223d-4a08-bd37-57371a9a67ed tempest-ServerActionsTestOtherA-2024956670 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43', 'name': 'volume-cfbaad03-ad94-4aa4-9908-bed601c27244', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '174de080-216c-472f-9059-f6970e729419', 'enforce_multipath': True} {{(pid=86725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:11:37 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-ec9b79f0-018b-42b4-8acd-d50d1b08cd9b req-4a301ad7-223d-4a08-bd37-57371a9a67ed tempest-ServerActionsTestOtherA-2024956670 None] attachment_update completed successfully. Nov 03 13:11:38 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-47a06cee-0586-4700-b0c9-54221c76ad67 tempest-GroupsTest-1987018071 None] Acquiring lock "cinder-quobyte-3a31a9c5-103e-4495-933b-b13320d643e4" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:11:38 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-47a06cee-0586-4700-b0c9-54221c76ad67 tempest-GroupsTest-1987018071 None] Lock "cinder-quobyte-3a31a9c5-103e-4495-933b-b13320d643e4" acquired by "delete_volume" :: waited 0.017s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:11:38 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f43d42-8f3d-4e7e-835a-0c0af97ec907]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:11:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-47a06cee-0586-4700-b0c9-54221c76ad67 tempest-GroupsTest-1987018071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3a31a9c5-103e-4495-933b-b13320d643e4 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ef52f788-85a0-43ce-9a22-634bb23c0ca7 tempest-VolumesActionsTest-1062688026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:11:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ef52f788-85a0-43ce-9a22-634bb23c0ca7 tempest-VolumesActionsTest-1062688026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:11:38 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[319cb65d-d2cc-4324-930f-99f7b2844f31]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:11:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ef52f788-85a0-43ce-9a22-634bb23c0ca7 tempest-VolumesActionsTest-1062688026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:38 devstack sudo[93418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3a31a9c5-103e-4495-933b-b13320d643e4 Nov 03 13:11:38 devstack sudo[93418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:38 devstack sudo[93419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490 Nov 03 13:11:38 devstack sudo[93419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:39 devstack sudo[93418]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-47a06cee-0586-4700-b0c9-54221c76ad67 tempest-GroupsTest-1987018071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3a31a9c5-103e-4495-933b-b13320d643e4" returned: 0 in 0.490s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-47a06cee-0586-4700-b0c9-54221c76ad67 tempest-GroupsTest-1987018071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3a31a9c5-103e-4495-933b-b13320d643e4 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:39 devstack sudo[93419]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ef52f788-85a0-43ce-9a22-634bb23c0ca7 tempest-VolumesActionsTest-1062688026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490" returned: 0 in 0.470s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:39 devstack sudo[93428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3a31a9c5-103e-4495-933b-b13320d643e4 Nov 03 13:11:39 devstack sudo[93428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:39 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[71bfc1f1-49fc-4294-86f5-9aa8052167dd]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:11:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ef52f788-85a0-43ce-9a22-634bb23c0ca7 tempest-VolumesActionsTest-1062688026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:39 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:11:39 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] Flow 'volume_create_manager' (c954affc-18e7-495e-a22d-864b72603062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:11:39 devstack sudo[93430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490 Nov 03 13:11:39 devstack sudo[93430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:39 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d7874b6-305a-44eb-8670-717528fa6653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:11:39 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d7874b6-305a-44eb-8670-717528fa6653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-960284957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95977941-3421-4be3-988b-674bf84702b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19794791f1e2414ba57edb38242a425d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:11:39Z,use_quota=True,user_id='43d0b310bf30429f9651d28912576de7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:11:39 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (562653e7-8db7-48c1-9372-3465b981273d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:11:39 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (562653e7-8db7-48c1-9372-3465b981273d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:11:39 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f0f0559-e06c-4f44-a2b0-127e342e4969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:11:39 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f0f0559-e06c-4f44-a2b0-127e342e4969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95977941-3421-4be3-988b-674bf84702b0', 'volume_name': 'volume-95977941-3421-4be3-988b-674bf84702b0', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:11:39 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a757806-665e-4c62-8194-bb4fd1262a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:11:39 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a757806-665e-4c62-8194-bb4fd1262a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:11:39 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8687016d-f6e2-4962-8149-d333bea765e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:11:39 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] Volume 95977941-3421-4be3-988b-674bf84702b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95977941-3421-4be3-988b-674bf84702b0', 'volume_size': 1} Nov 03 13:11:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:11:39 devstack sudo[93428]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-47a06cee-0586-4700-b0c9-54221c76ad67 tempest-GroupsTest-1987018071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3a31a9c5-103e-4495-933b-b13320d643e4" returned: 0 in 0.295s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:39 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-47a06cee-0586-4700-b0c9-54221c76ad67 tempest-GroupsTest-1987018071 None] Lock "cinder-quobyte-3a31a9c5-103e-4495-933b-b13320d643e4" released by "delete_volume" :: held 0.860s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:11:39 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-47a06cee-0586-4700-b0c9-54221c76ad67 tempest-GroupsTest-1987018071 None] Created reservations ['5c82cee5-21c5-4291-8361-34d91a2f6908'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:11:39 devstack cinder-volume[86725]: WARNING cinder.quota [None req-47a06cee-0586-4700-b0c9-54221c76ad67 tempest-GroupsTest-1987018071 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-483323086 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-483323086, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:11:39 devstack cinder-volume[86725]: WARNING cinder.quota [None req-47a06cee-0586-4700-b0c9-54221c76ad67 tempest-GroupsTest-1987018071 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-483323086 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-483323086, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:11:39 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-47a06cee-0586-4700-b0c9-54221c76ad67 tempest-GroupsTest-1987018071 None] Created reservations ['bc1fb8bb-c0e5-4682-8d2e-48a48f59c013', '96c644ee-9e55-4076-85e0-e4e7abe4fb82', 'f046c465-6b47-42bf-a65f-eb0bb0505399', '74d1ab7c-a980-42fd-bf83-1a4ceca3cf09'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:11:39 devstack sudo[93430]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ef52f788-85a0-43ce-9a22-634bb23c0ca7 tempest-VolumesActionsTest-1062688026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490" returned: 0 in 0.468s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ef52f788-85a0-43ce-9a22-634bb23c0ca7 tempest-VolumesActionsTest-1062688026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490 /opt/stack/data/cinder/conversion/a79be6dc-5462-4a10-89c8-3873b4b51490.temp_image.1603a4e5-40c7-4176-9ce4-9df87dc4c242ptnfmqi3.img {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:39 devstack sudo[93436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490 /opt/stack/data/cinder/conversion/a79be6dc-5462-4a10-89c8-3873b4b51490.temp_image.1603a4e5-40c7-4176-9ce4-9df87dc4c242ptnfmqi3.img Nov 03 13:11:39 devstack sudo[93436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-47a06cee-0586-4700-b0c9-54221c76ad67 tempest-GroupsTest-1987018071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:11:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-47a06cee-0586-4700-b0c9-54221c76ad67 tempest-GroupsTest-1987018071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:11:39 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-47a06cee-0586-4700-b0c9-54221c76ad67 tempest-GroupsTest-1987018071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:11:39 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-47a06cee-0586-4700-b0c9-54221c76ad67 tempest-GroupsTest-1987018071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:11:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-47a06cee-0586-4700-b0c9-54221c76ad67 tempest-GroupsTest-1987018071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:11:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-47a06cee-0586-4700-b0c9-54221c76ad67 tempest-GroupsTest-1987018071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:39 devstack sudo[93438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:11:39 devstack sudo[93438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:39 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-0c061a9c-32f6-4521-baa5-0152d94d098e tempest-GroupsTest-1987018071 None] Created reservations ['0e9bc383-e6a7-4e4b-b3e3-130dbd9c92a0'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:11:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0c061a9c-32f6-4521-baa5-0152d94d098e tempest-GroupsTest-1987018071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:11:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0c061a9c-32f6-4521-baa5-0152d94d098e tempest-GroupsTest-1987018071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:11:40 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0c061a9c-32f6-4521-baa5-0152d94d098e tempest-GroupsTest-1987018071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:11:40 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0c061a9c-32f6-4521-baa5-0152d94d098e tempest-GroupsTest-1987018071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:11:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0c061a9c-32f6-4521-baa5-0152d94d098e tempest-GroupsTest-1987018071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:11:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0c061a9c-32f6-4521-baa5-0152d94d098e tempest-GroupsTest-1987018071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:40 devstack sudo[93438]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-47a06cee-0586-4700-b0c9-54221c76ad67 tempest-GroupsTest-1987018071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.416s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:40 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-47a06cee-0586-4700-b0c9-54221c76ad67 tempest-GroupsTest-1987018071 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:11:40 devstack sudo[93450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:11:40 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-47a06cee-0586-4700-b0c9-54221c76ad67 tempest-GroupsTest-1987018071 None] Delete group completed successfully. Nov 03 13:11:40 devstack sudo[93450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:40 devstack sudo[93450]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0c061a9c-32f6-4521-baa5-0152d94d098e tempest-GroupsTest-1987018071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.562s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:40 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-0c061a9c-32f6-4521-baa5-0152d94d098e tempest-GroupsTest-1987018071 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:11:40 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-0c061a9c-32f6-4521-baa5-0152d94d098e tempest-GroupsTest-1987018071 None] Delete group completed successfully. Nov 03 13:11:42 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-03af4093-b81e-492a-b917-c090c89b1c6b req-7f14c52a-6901-4970-ab57-5a65db02e896 tempest-ServerActionsTestOtherA-2024956670 None] Terminate volume connection completed successfully. Nov 03 13:11:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-03af4093-b81e-492a-b917-c090c89b1c6b req-7f14c52a-6901-4970-ab57-5a65db02e896 tempest-ServerActionsTestOtherA-2024956670 None] Deleting attachment 174de080-216c-472f-9059-f6970e729419. {{(pid=86725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:11:42 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-d0c0d0f1-0bdf-4df4-a087-5ac13953ea2c tempest-GroupsTest-1987018071 None] Group tempest-GroupsTest-Group-720426851: creating Nov 03 13:11:42 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-d0c0d0f1-0bdf-4df4-a087-5ac13953ea2c tempest-GroupsTest-1987018071 None] Group tempest-GroupsTest-Group-720426851: created successfully Nov 03 13:11:42 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-d0c0d0f1-0bdf-4df4-a087-5ac13953ea2c tempest-GroupsTest-1987018071 None] Create group completed successfully. Nov 03 13:11:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-03af4093-b81e-492a-b917-c090c89b1c6b req-97cf1e8d-7fb6-4690-af28-5e343e3fc78d tempest-ServerActionsTestOtherA-2024956670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:11:44 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:11:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] Flow 'volume_create_manager' (96e2e323-f7d2-4edf-98c9-0a87025ecc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:11:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33c67eac-537d-4e4d-842a-bded3ac9c513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:11:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33c67eac-537d-4e4d-842a-bded3ac9c513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1820952931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c05da0d4-c767-472e-a132-64413d8cede9,host='devstack@QuobyteHD#QuobyteHD',id=39c5bfc2-faa5-4334-b14f-2b03cdc8dd86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da49f5ba07b849fdaa676180762e91e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:11:45Z,use_quota=True,user_id='718c6ea7f44c427c82e05396dd4d8f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25de1e1d-b66c-455e-91a8-925088f645ee),volume_type_id=25de1e1d-b66c-455e-91a8-925088f645ee)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:11:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c23d5d-3484-4ccf-9043-7025eb8cfe49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:11:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c23d5d-3484-4ccf-9043-7025eb8cfe49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:11:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ed76b0f-f4b2-4973-8746-65a2c826297a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:11:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ed76b0f-f4b2-4973-8746-65a2c826297a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39c5bfc2-faa5-4334-b14f-2b03cdc8dd86', 'volume_name': 'volume-39c5bfc2-faa5-4334-b14f-2b03cdc8dd86', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:11:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80ae8327-9a5a-474f-b031-863c2202815b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:11:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80ae8327-9a5a-474f-b031-863c2202815b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:11:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff84dd68-aa8f-43af-b665-964c093db658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:11:44 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] Volume 39c5bfc2-faa5-4334-b14f-2b03cdc8dd86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39c5bfc2-faa5-4334-b14f-2b03cdc8dd86', 'volume_size': 1} Nov 03 13:11:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:11:47 devstack sudo[93436]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ef52f788-85a0-43ce-9a22-634bb23c0ca7 tempest-VolumesActionsTest-1062688026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490 /opt/stack/data/cinder/conversion/a79be6dc-5462-4a10-89c8-3873b4b51490.temp_image.1603a4e5-40c7-4176-9ce4-9df87dc4c242ptnfmqi3.img" returned: 0 in 7.822s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:47 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7666732-64a0-4e8a-bdc2-41a50c0a146c]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:11:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ef52f788-85a0-43ce-9a22-634bb23c0ca7 tempest-VolumesActionsTest-1062688026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:47 devstack sudo[93558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490 Nov 03 13:11:47 devstack sudo[93558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:47 devstack sudo[93558]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ef52f788-85a0-43ce-9a22-634bb23c0ca7 tempest-VolumesActionsTest-1062688026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490" returned: 0 in 0.524s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:47 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-ef52f788-85a0-43ce-9a22-634bb23c0ca7 tempest-VolumesActionsTest-1062688026 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490, size 1024.00 MB, duration 7.82 sec, destination /opt/stack/data/cinder/conversion/a79be6dc-5462-4a10-89c8-3873b4b51490.temp_image.1603a4e5-40c7-4176-9ce4-9df87dc4c242ptnfmqi3.img {{(pid=86725) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:11:47 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-ef52f788-85a0-43ce-9a22-634bb23c0ca7 tempest-VolumesActionsTest-1062688026 None] Converted 1024.00 MB image at 130.89 MB/s Nov 03 13:11:47 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-ef52f788-85a0-43ce-9a22-634bb23c0ca7 tempest-VolumesActionsTest-1062688026 None] 1603a4e5-40c7-4176-9ce4-9df87dc4c242 was raw, converting to qcow2 {{(pid=86725) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 03 13:11:48 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7f961d-fa55-49f2-81d3-bb5c14a01d51]: (4, 'raw') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:11:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ef52f788-85a0-43ce-9a22-634bb23c0ca7 tempest-VolumesActionsTest-1062688026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a79be6dc-5462-4a10-89c8-3873b4b51490.temp_image.1603a4e5-40c7-4176-9ce4-9df87dc4c242ptnfmqi3.img {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:48 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a79be6dc-5462-4a10-89c8-3873b4b51490.temp_image.1603a4e5-40c7-4176-9ce4-9df87dc4c242ptnfmqi3.img Nov 03 13:11:48 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:48 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ef52f788-85a0-43ce-9a22-634bb23c0ca7 tempest-VolumesActionsTest-1062688026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a79be6dc-5462-4a10-89c8-3873b4b51490.temp_image.1603a4e5-40c7-4176-9ce4-9df87dc4c242ptnfmqi3.img" returned: 0 in 0.318s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ef52f788-85a0-43ce-9a22-634bb23c0ca7 tempest-VolumesActionsTest-1062688026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a79be6dc-5462-4a10-89c8-3873b4b51490.temp_image.1603a4e5-40c7-4176-9ce4-9df87dc4c242ptnfmqi3.img {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:48 devstack sudo[93567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a79be6dc-5462-4a10-89c8-3873b4b51490.temp_image.1603a4e5-40c7-4176-9ce4-9df87dc4c242ptnfmqi3.img Nov 03 13:11:48 devstack sudo[93567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:48 devstack sudo[93567]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ef52f788-85a0-43ce-9a22-634bb23c0ca7 tempest-VolumesActionsTest-1062688026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a79be6dc-5462-4a10-89c8-3873b4b51490.temp_image.1603a4e5-40c7-4176-9ce4-9df87dc4c242ptnfmqi3.img" returned: 1 in 0.322s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ef52f788-85a0-43ce-9a22-634bb23c0ca7 tempest-VolumesActionsTest-1062688026 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a79be6dc-5462-4a10-89c8-3873b4b51490.temp_image.1603a4e5-40c7-4176-9ce4-9df87dc4c242ptnfmqi3.img' failed. Not Retrying. {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:11:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ef52f788-85a0-43ce-9a22-634bb23c0ca7 tempest-VolumesActionsTest-1062688026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a79be6dc-5462-4a10-89c8-3873b4b51490.temp_image.1603a4e5-40c7-4176-9ce4-9df87dc4c242ptnfmqi3.img /opt/stack/data/cinder/conversion/vol_upload_p5lrcshu {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:48 devstack sudo[93572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a79be6dc-5462-4a10-89c8-3873b4b51490.temp_image.1603a4e5-40c7-4176-9ce4-9df87dc4c242ptnfmqi3.img /opt/stack/data/cinder/conversion/vol_upload_p5lrcshu Nov 03 13:11:48 devstack sudo[93572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:48 devstack sudo[93572]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ef52f788-85a0-43ce-9a22-634bb23c0ca7 tempest-VolumesActionsTest-1062688026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a79be6dc-5462-4a10-89c8-3873b4b51490.temp_image.1603a4e5-40c7-4176-9ce4-9df87dc4c242ptnfmqi3.img /opt/stack/data/cinder/conversion/vol_upload_p5lrcshu" returned: 0 in 0.253s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:48 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-ef52f788-85a0-43ce-9a22-634bb23c0ca7 tempest-VolumesActionsTest-1062688026 None] Image conversion details: src /opt/stack/data/cinder/conversion/a79be6dc-5462-4a10-89c8-3873b4b51490.temp_image.1603a4e5-40c7-4176-9ce4-9df87dc4c242ptnfmqi3.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_p5lrcshu {{(pid=86725) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:11:48 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-ef52f788-85a0-43ce-9a22-634bb23c0ca7 tempest-VolumesActionsTest-1062688026 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 03 13:11:48 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3501b02-4d4b-4ec3-9dc5-9a0f30823b3f]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:11:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ef52f788-85a0-43ce-9a22-634bb23c0ca7 tempest-VolumesActionsTest-1062688026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_p5lrcshu {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:49 devstack sudo[93577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_p5lrcshu Nov 03 13:11:49 devstack sudo[93577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:49 devstack sudo[93577]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ef52f788-85a0-43ce-9a22-634bb23c0ca7 tempest-VolumesActionsTest-1062688026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_p5lrcshu" returned: 0 in 0.312s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ef52f788-85a0-43ce-9a22-634bb23c0ca7 tempest-VolumesActionsTest-1062688026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.846s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:11:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ef52f788-85a0-43ce-9a22-634bb23c0ca7 tempest-VolumesActionsTest-1062688026 None] Uploaded volume to glance image-id: 1603a4e5-40c7-4176-9ce4-9df87dc4c242. {{(pid=86725) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 13:11:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.134s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:11:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-960284957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95977941-3421-4be3-988b-674bf84702b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19794791f1e2414ba57edb38242a425d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:11:39Z,use_quota=True,user_id='43d0b310bf30429f9651d28912576de7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:11:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] Creating volume 95977941-3421-4be3-988b-674bf84702b0 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:11:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:11:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:11:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:11:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:11:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:11:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:11:50 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:11:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-95977941-3421-4be3-988b-674bf84702b0 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:50 devstack sudo[93582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-95977941-3421-4be3-988b-674bf84702b0 1073741824 Nov 03 13:11:50 devstack sudo[93582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:50 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-ef52f788-85a0-43ce-9a22-634bb23c0ca7 tempest-VolumesActionsTest-1062688026 None] Copy volume to image completed successfully. Nov 03 13:11:50 devstack sudo[93582]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-95977941-3421-4be3-988b-674bf84702b0 1073741824" returned: 0 in 0.428s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-95977941-3421-4be3-988b-674bf84702b0 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:50 devstack sudo[93587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-95977941-3421-4be3-988b-674bf84702b0 Nov 03 13:11:50 devstack sudo[93587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:51 devstack sudo[93587]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-95977941-3421-4be3-988b-674bf84702b0" returned: 0 in 0.242s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:11:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:11:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-03af4093-b81e-492a-b917-c090c89b1c6b req-97cf1e8d-7fb6-4690-af28-5e343e3fc78d tempest-ServerActionsTestOtherA-2024956670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.462s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:11:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8687016d-f6e2-4962-8149-d333bea765e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95977941-3421-4be3-988b-674bf84702b0', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:11:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e4d8eb-208e-4972-8fd2-90b15df9836c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:11:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-03af4093-b81e-492a-b917-c090c89b1c6b req-97cf1e8d-7fb6-4690-af28-5e343e3fc78d tempest-ServerActionsTestOtherA-2024956670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:11:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.233s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:11:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c05da0d4-c767-472e-a132-64413d8cede9,created_at=2026-11-03T12:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1820952931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c05da0d4-c767-472e-a132-64413d8cede9,host='devstack@QuobyteHD#QuobyteHD',id=39c5bfc2-faa5-4334-b14f-2b03cdc8dd86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da49f5ba07b849fdaa676180762e91e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:11:45Z,use_quota=True,user_id='718c6ea7f44c427c82e05396dd4d8f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25de1e1d-b66c-455e-91a8-925088f645ee),volume_type_id=25de1e1d-b66c-455e-91a8-925088f645ee)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:11:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] Creating volume 39c5bfc2-faa5-4334-b14f-2b03cdc8dd86 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:11:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:11:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:11:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:11:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:11:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:11:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:11:51 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:11:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-39c5bfc2-faa5-4334-b14f-2b03cdc8dd86 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:51 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] Volume volume-95977941-3421-4be3-988b-674bf84702b0 (95977941-3421-4be3-988b-674bf84702b0): created successfully Nov 03 13:11:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e4d8eb-208e-4972-8fd2-90b15df9836c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:11:51 devstack sudo[93590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-39c5bfc2-faa5-4334-b14f-2b03cdc8dd86 1073741824 Nov 03 13:11:51 devstack sudo[93590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] Flow 'volume_create_manager' (c954affc-18e7-495e-a22d-864b72603062) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:11:51 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-535f982f-c210-4c8e-986b-bddc0c1520d7 tempest-AttachVolumeNegativeTest-621359088 None] Created volume successfully. Nov 03 13:11:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-03af4093-b81e-492a-b917-c090c89b1c6b req-97cf1e8d-7fb6-4690-af28-5e343e3fc78d tempest-ServerActionsTestOtherA-2024956670 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43', 'name': 'volume-cfbaad03-ad94-4aa4-9908-bed601c27244', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7b46fbb4-5633-497e-b09d-ca2887acdce0', 'enforce_multipath': True} {{(pid=86725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:11:51 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-03af4093-b81e-492a-b917-c090c89b1c6b req-97cf1e8d-7fb6-4690-af28-5e343e3fc78d tempest-ServerActionsTestOtherA-2024956670 None] attachment_update completed successfully. Nov 03 13:11:51 devstack sudo[93590]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-39c5bfc2-faa5-4334-b14f-2b03cdc8dd86 1073741824" returned: 0 in 0.527s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-39c5bfc2-faa5-4334-b14f-2b03cdc8dd86 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:51 devstack sudo[93598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-39c5bfc2-faa5-4334-b14f-2b03cdc8dd86 Nov 03 13:11:51 devstack sudo[93598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-bc78f2ef-e4a8-4d29-a87f-833b8368ab6c tempest-VolumesActionsTest-1062688026 None] Acquiring lock "cinder-a79be6dc-5462-4a10-89c8-3873b4b51490-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:11:52 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-bc78f2ef-e4a8-4d29-a87f-833b8368ab6c tempest-VolumesActionsTest-1062688026 None] Lock "cinder-a79be6dc-5462-4a10-89c8-3873b4b51490-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:11:52 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-bc78f2ef-e4a8-4d29-a87f-833b8368ab6c tempest-VolumesActionsTest-1062688026 None] Acquiring lock "cinder-quobyte-a79be6dc-5462-4a10-89c8-3873b4b51490" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:11:52 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-bc78f2ef-e4a8-4d29-a87f-833b8368ab6c tempest-VolumesActionsTest-1062688026 None] Lock "cinder-quobyte-a79be6dc-5462-4a10-89c8-3873b4b51490" acquired by "delete_volume" :: waited 0.015s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:11:52 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[9807c3fe-442e-4a46-9fc0-8f8275e23044]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:11:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-bc78f2ef-e4a8-4d29-a87f-833b8368ab6c tempest-VolumesActionsTest-1062688026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:52 devstack sudo[93598]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-39c5bfc2-faa5-4334-b14f-2b03cdc8dd86" returned: 0 in 0.357s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:52 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:11:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:11:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff84dd68-aa8f-43af-b665-964c093db658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39c5bfc2-faa5-4334-b14f-2b03cdc8dd86', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:11:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99327cd4-c9db-4bee-afdb-3f1cc56a304b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:11:52 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] Volume volume-39c5bfc2-faa5-4334-b14f-2b03cdc8dd86 (39c5bfc2-faa5-4334-b14f-2b03cdc8dd86): created successfully Nov 03 13:11:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99327cd4-c9db-4bee-afdb-3f1cc56a304b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:11:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] Flow 'volume_create_manager' (96e2e323-f7d2-4edf-98c9-0a87025ecc49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:11:52 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-f8cb5971-c1c4-4416-bc9e-e19befdec3c5 tempest-GroupsTest-1987018071 None] Created volume successfully. Nov 03 13:11:52 devstack sudo[93610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490 Nov 03 13:11:52 devstack sudo[93610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:52 devstack sudo[93610]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-bc78f2ef-e4a8-4d29-a87f-833b8368ab6c tempest-VolumesActionsTest-1062688026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490" returned: 0 in 0.480s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-bc78f2ef-e4a8-4d29-a87f-833b8368ab6c tempest-VolumesActionsTest-1062688026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:52 devstack sudo[93649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490 Nov 03 13:11:52 devstack sudo[93649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:52 devstack sudo[93649]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-bc78f2ef-e4a8-4d29-a87f-833b8368ab6c tempest-VolumesActionsTest-1062688026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a79be6dc-5462-4a10-89c8-3873b4b51490" returned: 0 in 0.359s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-bc78f2ef-e4a8-4d29-a87f-833b8368ab6c tempest-VolumesActionsTest-1062688026 None] Lock "cinder-quobyte-a79be6dc-5462-4a10-89c8-3873b4b51490" released by "delete_volume" :: held 0.927s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:11:53 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-bc78f2ef-e4a8-4d29-a87f-833b8368ab6c tempest-VolumesActionsTest-1062688026 None] Created reservations ['11e0069d-cd6b-49c2-92e7-18ab1d7c734d', 'a54fe240-8eaf-45f6-870a-368c846f15c3', '4b276510-5982-471b-8556-70922f392379', 'b5a36d7f-44ea-4534-80cd-849fd7c2b2d2'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:11:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-529c5afe-182a-40c0-8d44-efd9c473c761 req-d5335552-343a-4748-b35c-c492d8aa7eb1 tempest-AttachVolumeNegativeTest-621359088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:11:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-529c5afe-182a-40c0-8d44-efd9c473c761 req-d5335552-343a-4748-b35c-c492d8aa7eb1 tempest-AttachVolumeNegativeTest-621359088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:11:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-bc78f2ef-e4a8-4d29-a87f-833b8368ab6c tempest-VolumesActionsTest-1062688026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:11:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-bc78f2ef-e4a8-4d29-a87f-833b8368ab6c tempest-VolumesActionsTest-1062688026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:11:53 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-bc78f2ef-e4a8-4d29-a87f-833b8368ab6c tempest-VolumesActionsTest-1062688026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:11:53 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-bc78f2ef-e4a8-4d29-a87f-833b8368ab6c tempest-VolumesActionsTest-1062688026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:11:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-bc78f2ef-e4a8-4d29-a87f-833b8368ab6c tempest-VolumesActionsTest-1062688026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:11:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-bc78f2ef-e4a8-4d29-a87f-833b8368ab6c tempest-VolumesActionsTest-1062688026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:53 devstack sudo[93757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:11:53 devstack sudo[93757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-529c5afe-182a-40c0-8d44-efd9c473c761 req-d5335552-343a-4748-b35c-c492d8aa7eb1 tempest-AttachVolumeNegativeTest-621359088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.090s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:11:53 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-529c5afe-182a-40c0-8d44-efd9c473c761 req-d5335552-343a-4748-b35c-c492d8aa7eb1 tempest-AttachVolumeNegativeTest-621359088 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43', 'name': 'volume-95977941-3421-4be3-988b-674bf84702b0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'acdec246-6727-4837-800e-084065eaa5de', 'enforce_multipath': True} {{(pid=86725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:11:53 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-529c5afe-182a-40c0-8d44-efd9c473c761 req-d5335552-343a-4748-b35c-c492d8aa7eb1 tempest-AttachVolumeNegativeTest-621359088 None] attachment_update completed successfully. Nov 03 13:11:53 devstack sudo[93757]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-bc78f2ef-e4a8-4d29-a87f-833b8368ab6c tempest-VolumesActionsTest-1062688026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.622s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:53 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-bc78f2ef-e4a8-4d29-a87f-833b8368ab6c tempest-VolumesActionsTest-1062688026 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:11:54 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-bc78f2ef-e4a8-4d29-a87f-833b8368ab6c tempest-VolumesActionsTest-1062688026 None] Deleted volume successfully. Nov 03 13:11:54 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-bc78f2ef-e4a8-4d29-a87f-833b8368ab6c tempest-VolumesActionsTest-1062688026 None] Lock "cinder-a79be6dc-5462-4a10-89c8-3873b4b51490-delete_volume" released by "delete_volume" :: held 2.048s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:11:54 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:11:54 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] Flow 'volume_create_manager' (c169684c-2d3e-4d5b-b30d-e8c9effbf097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:11:54 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53cd8fbe-2eb7-44c4-b6d8-4b72e2183627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:11:54 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53cd8fbe-2eb7-44c4-b6d8-4b72e2183627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-861974048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c05da0d4-c767-472e-a132-64413d8cede9,host='devstack@QuobyteHD#QuobyteHD',id=d97cab0d-4516-4797-a29c-e4d03cd5af76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da49f5ba07b849fdaa676180762e91e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:11:55Z,use_quota=True,user_id='718c6ea7f44c427c82e05396dd4d8f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25de1e1d-b66c-455e-91a8-925088f645ee),volume_type_id=25de1e1d-b66c-455e-91a8-925088f645ee)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:11:54 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (420f38b1-caea-479d-a39a-6f6cf1a85c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:11:54 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (420f38b1-caea-479d-a39a-6f6cf1a85c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:11:54 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8ca02b0-2379-481f-ab3d-394ed0dfb76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:11:54 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8ca02b0-2379-481f-ab3d-394ed0dfb76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd97cab0d-4516-4797-a29c-e4d03cd5af76', 'volume_name': 'volume-d97cab0d-4516-4797-a29c-e4d03cd5af76', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:11:54 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e69122f6-4b0c-4bc7-a05a-37eae6811c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:11:54 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e69122f6-4b0c-4bc7-a05a-37eae6811c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:11:54 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08da11c3-6a41-4980-b7fc-5196e6892a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:11:54 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] Volume d97cab0d-4516-4797-a29c-e4d03cd5af76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d97cab0d-4516-4797-a29c-e4d03cd5af76', 'volume_size': 1} Nov 03 13:11:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:11:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:11:54 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c05da0d4-c767-472e-a132-64413d8cede9,created_at=2026-11-03T12:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-861974048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c05da0d4-c767-472e-a132-64413d8cede9,host='devstack@QuobyteHD#QuobyteHD',id=d97cab0d-4516-4797-a29c-e4d03cd5af76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da49f5ba07b849fdaa676180762e91e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:11:55Z,use_quota=True,user_id='718c6ea7f44c427c82e05396dd4d8f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25de1e1d-b66c-455e-91a8-925088f645ee),volume_type_id=25de1e1d-b66c-455e-91a8-925088f645ee)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:11:54 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] Creating volume d97cab0d-4516-4797-a29c-e4d03cd5af76 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:11:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:11:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:11:54 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:11:54 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:11:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:11:54 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:11:54 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:11:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d97cab0d-4516-4797-a29c-e4d03cd5af76 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:54 devstack sudo[94099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d97cab0d-4516-4797-a29c-e4d03cd5af76 1073741824 Nov 03 13:11:54 devstack sudo[94099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:55 devstack sudo[94099]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d97cab0d-4516-4797-a29c-e4d03cd5af76 1073741824" returned: 0 in 0.709s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d97cab0d-4516-4797-a29c-e4d03cd5af76 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:55 devstack sudo[94114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d97cab0d-4516-4797-a29c-e4d03cd5af76 Nov 03 13:11:55 devstack sudo[94114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:56 devstack sudo[94114]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d97cab0d-4516-4797-a29c-e4d03cd5af76" returned: 0 in 0.643s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:56 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:11:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:11:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08da11c3-6a41-4980-b7fc-5196e6892a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d97cab0d-4516-4797-a29c-e4d03cd5af76', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:11:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6acdb338-2f4d-423f-975a-e1494577ce13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:11:56 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] Volume volume-d97cab0d-4516-4797-a29c-e4d03cd5af76 (d97cab0d-4516-4797-a29c-e4d03cd5af76): created successfully Nov 03 13:11:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6acdb338-2f4d-423f-975a-e1494577ce13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:11:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] Flow 'volume_create_manager' (c169684c-2d3e-4d5b-b30d-e8c9effbf097) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:11:56 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-f5d96ce0-e4f8-4532-a30f-a62aca695a8c tempest-GroupsTest-1987018071 None] Created volume successfully. Nov 03 13:11:56 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-06d3f9b5-59ec-40a4-abea-b32e3360f9d7 req-c0459086-331f-412c-bbb0-6e8fe0ea0ba5 tempest-AttachVolumeNegativeTest-621359088 None] Terminate volume connection completed successfully. Nov 03 13:11:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-06d3f9b5-59ec-40a4-abea-b32e3360f9d7 req-c0459086-331f-412c-bbb0-6e8fe0ea0ba5 tempest-AttachVolumeNegativeTest-621359088 None] Deleting attachment acdec246-6727-4837-800e-084065eaa5de. {{(pid=86725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:11:57 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-d48d6a28-1a56-40ad-88a6-a4ea57f8a1f6 tempest-GroupsTest-1987018071 None] Update group completed successfully. Nov 03 13:11:58 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:11:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:11:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:11:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:11:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:11:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:11:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:58 devstack sudo[94143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:11:58 devstack sudo[94143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:59 devstack sudo[94143]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.474s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:59 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:11:59 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager._thread_info {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:11:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread count: 28 {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:11:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread info: [<_MainThread(MainThread, started 133507074375808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:11:59 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-c8f2ac99-71c1-4446-aef7-3608b3343240 tempest-GroupsTest-1987018071 None] Update group completed successfully. Nov 03 13:12:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-f6bbaf2d-b26d-4a4d-b90e-7d39d3a28f62 tempest-GroupsTest-1987018071 None] Acquiring lock "cinder-quobyte-39c5bfc2-faa5-4334-b14f-2b03cdc8dd86" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-f6bbaf2d-b26d-4a4d-b90e-7d39d3a28f62 tempest-GroupsTest-1987018071 None] Lock "cinder-quobyte-39c5bfc2-faa5-4334-b14f-2b03cdc8dd86" acquired by "delete_volume" :: waited 0.024s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:01 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0df189-c553-4558-815b-7fb40f8581e5]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f6bbaf2d-b26d-4a4d-b90e-7d39d3a28f62 tempest-GroupsTest-1987018071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-39c5bfc2-faa5-4334-b14f-2b03cdc8dd86 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:01 devstack sudo[94149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-39c5bfc2-faa5-4334-b14f-2b03cdc8dd86 Nov 03 13:12:01 devstack sudo[94149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:01 devstack sudo[94149]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f6bbaf2d-b26d-4a4d-b90e-7d39d3a28f62 tempest-GroupsTest-1987018071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-39c5bfc2-faa5-4334-b14f-2b03cdc8dd86" returned: 0 in 0.653s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f6bbaf2d-b26d-4a4d-b90e-7d39d3a28f62 tempest-GroupsTest-1987018071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-39c5bfc2-faa5-4334-b14f-2b03cdc8dd86 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:01 devstack sudo[94155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-39c5bfc2-faa5-4334-b14f-2b03cdc8dd86 Nov 03 13:12:01 devstack sudo[94155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:02 devstack sudo[94155]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f6bbaf2d-b26d-4a4d-b90e-7d39d3a28f62 tempest-GroupsTest-1987018071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-39c5bfc2-faa5-4334-b14f-2b03cdc8dd86" returned: 0 in 0.353s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-f6bbaf2d-b26d-4a4d-b90e-7d39d3a28f62 tempest-GroupsTest-1987018071 None] Lock "cinder-quobyte-39c5bfc2-faa5-4334-b14f-2b03cdc8dd86" released by "delete_volume" :: held 1.067s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-f6bbaf2d-b26d-4a4d-b90e-7d39d3a28f62 tempest-GroupsTest-1987018071 None] Acquiring lock "cinder-quobyte-d97cab0d-4516-4797-a29c-e4d03cd5af76" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-f6bbaf2d-b26d-4a4d-b90e-7d39d3a28f62 tempest-GroupsTest-1987018071 None] Lock "cinder-quobyte-d97cab0d-4516-4797-a29c-e4d03cd5af76" acquired by "delete_volume" :: waited 0.029s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:02 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d09592-7b9f-4fe4-9d58-520a5f080d5f]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f6bbaf2d-b26d-4a4d-b90e-7d39d3a28f62 tempest-GroupsTest-1987018071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d97cab0d-4516-4797-a29c-e4d03cd5af76 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:02 devstack sudo[94158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d97cab0d-4516-4797-a29c-e4d03cd5af76 Nov 03 13:12:02 devstack sudo[94158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:02 devstack sudo[94158]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f6bbaf2d-b26d-4a4d-b90e-7d39d3a28f62 tempest-GroupsTest-1987018071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d97cab0d-4516-4797-a29c-e4d03cd5af76" returned: 0 in 0.581s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f6bbaf2d-b26d-4a4d-b90e-7d39d3a28f62 tempest-GroupsTest-1987018071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d97cab0d-4516-4797-a29c-e4d03cd5af76 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:02 devstack sudo[94164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d97cab0d-4516-4797-a29c-e4d03cd5af76 Nov 03 13:12:02 devstack sudo[94164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:03 devstack sudo[94164]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f6bbaf2d-b26d-4a4d-b90e-7d39d3a28f62 tempest-GroupsTest-1987018071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d97cab0d-4516-4797-a29c-e4d03cd5af76" returned: 0 in 0.376s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:03 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-f6bbaf2d-b26d-4a4d-b90e-7d39d3a28f62 tempest-GroupsTest-1987018071 None] Lock "cinder-quobyte-d97cab0d-4516-4797-a29c-e4d03cd5af76" released by "delete_volume" :: held 1.027s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:03 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-f6bbaf2d-b26d-4a4d-b90e-7d39d3a28f62 tempest-GroupsTest-1987018071 None] Created reservations ['6ab557a6-79d9-414a-858e-1206c59e2fe4'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:12:03 devstack cinder-volume[86725]: WARNING cinder.quota [None req-f6bbaf2d-b26d-4a4d-b90e-7d39d3a28f62 tempest-GroupsTest-1987018071 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-755530911 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-755530911, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:12:03 devstack cinder-volume[86725]: WARNING cinder.quota [None req-f6bbaf2d-b26d-4a4d-b90e-7d39d3a28f62 tempest-GroupsTest-1987018071 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-755530911 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-755530911, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:12:03 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-f6bbaf2d-b26d-4a4d-b90e-7d39d3a28f62 tempest-GroupsTest-1987018071 None] Created reservations ['37ce721d-b6b9-4462-aef3-7d7fd057fe11', 'a464723e-5a1d-48fc-aa5b-479ac5c54322', 'ff203273-f0ab-4bae-9226-1e7e2d4dae50', 'b86e6fce-5c79-4c20-b875-531bdde26280'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:12:03 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-f6bbaf2d-b26d-4a4d-b90e-7d39d3a28f62 tempest-GroupsTest-1987018071 None] Created reservations ['8abcfe80-c859-422d-ab3b-b37ac34ddb88', '0a71ed4c-6107-4201-8620-c0fd822b6dac', 'dbcb4908-67bf-46cd-bbac-4c3c95c31426', '7c126b51-0a8e-498c-8a00-253508e2d7b9'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:12:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f6bbaf2d-b26d-4a4d-b90e-7d39d3a28f62 tempest-GroupsTest-1987018071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f6bbaf2d-b26d-4a4d-b90e-7d39d3a28f62 tempest-GroupsTest-1987018071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:03 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f6bbaf2d-b26d-4a4d-b90e-7d39d3a28f62 tempest-GroupsTest-1987018071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:03 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f6bbaf2d-b26d-4a4d-b90e-7d39d3a28f62 tempest-GroupsTest-1987018071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f6bbaf2d-b26d-4a4d-b90e-7d39d3a28f62 tempest-GroupsTest-1987018071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f6bbaf2d-b26d-4a4d-b90e-7d39d3a28f62 tempest-GroupsTest-1987018071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:03 devstack sudo[94167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:12:03 devstack sudo[94167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:04 devstack sudo[94167]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f6bbaf2d-b26d-4a4d-b90e-7d39d3a28f62 tempest-GroupsTest-1987018071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.423s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:04 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-f6bbaf2d-b26d-4a4d-b90e-7d39d3a28f62 tempest-GroupsTest-1987018071 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:12:04 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-f6bbaf2d-b26d-4a4d-b90e-7d39d3a28f62 tempest-GroupsTest-1987018071 None] Delete group completed successfully. Nov 03 13:12:07 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:12:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] Flow 'volume_create_manager' (66af2a75-6679-4ee9-b821-cb7bb7cc1ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb8f4505-84d1-4c00-a3d3-ffc9d8c41e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb8f4505-84d1-4c00-a3d3-ffc9d8c41e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-63373782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f610ca6-0d62-4f2c-9708-7861a214f0dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f2b29c3336d43d8b15d6aa7390d6188',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:07Z,use_quota=True,user_id='bece9aa81cbb487bbfd746724ee0c123',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (726a526f-e0b0-42c9-bf38-ebdd7a393292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (726a526f-e0b0-42c9-bf38-ebdd7a393292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1add1f0e-a994-4f1d-9983-935af662d7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1add1f0e-a994-4f1d-9983-935af662d7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f610ca6-0d62-4f2c-9708-7861a214f0dd', 'volume_name': 'volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb3e1d1f-95fd-4532-a9b5-dc1cd1901604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb3e1d1f-95fd-4532-a9b5-dc1cd1901604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf5bd20-22e6-4f2f-ab88-f199eddeeb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:07 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] Volume 9f610ca6-0d62-4f2c-9708-7861a214f0dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd', 'volume_size': 1} Nov 03 13:12:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:07 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-63373782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f610ca6-0d62-4f2c-9708-7861a214f0dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f2b29c3336d43d8b15d6aa7390d6188',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:07Z,use_quota=True,user_id='bece9aa81cbb487bbfd746724ee0c123',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:12:07 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] Creating volume 9f610ca6-0d62-4f2c-9708-7861a214f0dd {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:12:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:07 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:07 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:07 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:12:07 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:12:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:07 devstack sudo[94171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd 1073741824 Nov 03 13:12:07 devstack sudo[94171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:07 devstack sudo[94171]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd 1073741824" returned: 0 in 0.643s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:07 devstack sudo[94183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd Nov 03 13:12:07 devstack sudo[94183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:08 devstack sudo[94183]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd" returned: 0 in 0.477s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:08 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:12:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf5bd20-22e6-4f2f-ab88-f199eddeeb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2efb125c-5486-4c48-9d0e-367483d370fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:08 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] Volume volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd (9f610ca6-0d62-4f2c-9708-7861a214f0dd): created successfully Nov 03 13:12:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2efb125c-5486-4c48-9d0e-367483d370fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] Flow 'volume_create_manager' (66af2a75-6679-4ee9-b821-cb7bb7cc1ded) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:08 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-f04b933c-dfc6-44ee-83d6-92f104df1ce3 tempest-VolumesCloneTest-979371548 None] Created volume successfully. Nov 03 13:12:09 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:12:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Flow 'volume_create_manager' (729df456-3037-48d0-9746-b88891e789a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40f10ebc-b222-4b09-9f73-88ed7e3b3fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40f10ebc-b222-4b09-9f73-88ed7e3b3fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-476646613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b1437f3-2d33-496b-b44e-d6f186377a2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f2b29c3336d43d8b15d6aa7390d6188',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=9f610ca6-0d62-4f2c-9708-7861a214f0dd,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:10Z,use_quota=True,user_id='bece9aa81cbb487bbfd746724ee0c123',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b0edf61-ff30-470c-8420-fd81836f8e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b0edf61-ff30-470c-8420-fd81836f8e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6781f6e2-a359-496b-8201-b7814cdf021e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6781f6e2-a359-496b-8201-b7814cdf021e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3b1437f3-2d33-496b-b44e-d6f186377a2f', 'volume_name': 'volume-3b1437f3-2d33-496b-b44e-d6f186377a2f', 'volume_size': 2, 'source_volid': '9f610ca6-0d62-4f2c-9708-7861a214f0dd', 'source_volstatus': 'available'}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bbb407a-92a4-43bb-ad9d-433c666b07ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bbb407a-92a4-43bb-ad9d-433c666b07ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18a4b695-eb80-427e-9f8a-1b6989e1cc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:09 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Volume 3b1437f3-2d33-496b-b44e-d6f186377a2f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3b1437f3-2d33-496b-b44e-d6f186377a2f', 'volume_size': 2, 'source_volid': '9f610ca6-0d62-4f2c-9708-7861a214f0dd', 'source_volstatus': 'available'} Nov 03 13:12:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:09 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Cloning volume 9f610ca6-0d62-4f2c-9708-7861a214f0dd to volume 3b1437f3-2d33-496b-b44e-d6f186377a2f Nov 03 13:12:10 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Creating offline snapshot 3912d2b0-e9bc-43a1-87b2-e269632b63f6 of volume 9f610ca6-0d62-4f2c-9708-7861a214f0dd {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:12:10 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a9e7ea-d15b-4635-9959-8600976998be]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:10 devstack sudo[94219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd Nov 03 13:12:10 devstack sudo[94219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:10 devstack sudo[94219]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd" returned: 0 in 0.561s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd.3912d2b0-e9bc-43a1-87b2-e269632b63f6 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:10 devstack sudo[94229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd.3912d2b0-e9bc-43a1-87b2-e269632b63f6 1G Nov 03 13:12:10 devstack sudo[94229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:11 devstack sudo[94229]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd.3912d2b0-e9bc-43a1-87b2-e269632b63f6 1G" returned: 0 in 0.458s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd.3912d2b0-e9bc-43a1-87b2-e269632b63f6 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:11 devstack sudo[94235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd.3912d2b0-e9bc-43a1-87b2-e269632b63f6 Nov 03 13:12:11 devstack sudo[94235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:11 devstack sudo[94235]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd.3912d2b0-e9bc-43a1-87b2-e269632b63f6" returned: 0 in 0.351s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:11 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd.3912d2b0-e9bc-43a1-87b2-e269632b63f6 is being set with open permissions: ugo+rw Nov 03 13:12:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd.3912d2b0-e9bc-43a1-87b2-e269632b63f6 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:11 devstack sudo[94240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd.3912d2b0-e9bc-43a1-87b2-e269632b63f6 Nov 03 13:12:11 devstack sudo[94240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:11 devstack sudo[94240]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd.3912d2b0-e9bc-43a1-87b2-e269632b63f6" returned: 0 in 0.316s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:11 devstack sudo[94244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd.info Nov 03 13:12:11 devstack sudo[94244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:12 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-99e1fea2-a5c5-405a-915a-61ebbfbed78c tempest-GroupsV320Test-532300303 None] Group tempest-GroupsV320Test-Group-1221083016: creating Nov 03 13:12:12 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-99e1fea2-a5c5-405a-915a-61ebbfbed78c tempest-GroupsV320Test-532300303 None] Group tempest-GroupsV320Test-Group-1221083016: created successfully Nov 03 13:12:12 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-99e1fea2-a5c5-405a-915a-61ebbfbed78c tempest-GroupsV320Test-532300303 None] Create group completed successfully. Nov 03 13:12:12 devstack sudo[94244]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd.info" returned: 0 in 0.308s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:12 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd.info is being set with open permissions: ugo+rw Nov 03 13:12:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:12 devstack sudo[94247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd.info Nov 03 13:12:12 devstack sudo[94247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:12 devstack sudo[94247]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd.info" returned: 0 in 0.272s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:12 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Acquiring lock "cinder-quobyte-3b1437f3-2d33-496b-b44e-d6f186377a2f" by "_copy_volume_from_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:12 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Lock "cinder-quobyte-3b1437f3-2d33-496b-b44e-d6f186377a2f" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:12 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] snapshot: 3912d2b0-e9bc-43a1-87b2-e269632b63f6, volume: 3b1437f3-2d33-496b-b44e-d6f186377a2f, {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 13:12:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:12 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:12 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:12 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[5214f383-4b78-412e-9263-efd60e6f1e11]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd.3912d2b0-e9bc-43a1-87b2-e269632b63f6 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:12 devstack sudo[94268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd.3912d2b0-e9bc-43a1-87b2-e269632b63f6 Nov 03 13:12:12 devstack sudo[94268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:13 devstack sudo[94268]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd.3912d2b0-e9bc-43a1-87b2-e269632b63f6" returned: 0 in 0.648s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:12:13 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5a924a-7960-4feb-a6c3-346c0f02b36b]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:13 devstack sudo[94340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd Nov 03 13:12:13 devstack sudo[94340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:13 devstack sudo[94340]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd" returned: 0 in 0.679s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 13:12:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Creating direct copy from snapshot {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 13:12:13 devstack cinder-volume[86725]: DEBUG cinder.utils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Path /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3b1437f3-2d33-496b-b44e-d6f186377a2f not found in is_blk_device check {{(pid=86725) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 13:12:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3b1437f3-2d33-496b-b44e-d6f186377a2f {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:13 devstack sudo[94350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3b1437f3-2d33-496b-b44e-d6f186377a2f Nov 03 13:12:13 devstack sudo[94350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:14 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-3b47bead-2cd2-4f80-a8a3-27633c9aabed tempest-GroupsV320Test-532300303 None] Created reservations ['e495488a-e3d6-4d92-8c96-a738bb0edd5a'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:12:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3b47bead-2cd2-4f80-a8a3-27633c9aabed tempest-GroupsV320Test-532300303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3b47bead-2cd2-4f80-a8a3-27633c9aabed tempest-GroupsV320Test-532300303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:14 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3b47bead-2cd2-4f80-a8a3-27633c9aabed tempest-GroupsV320Test-532300303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:14 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3b47bead-2cd2-4f80-a8a3-27633c9aabed tempest-GroupsV320Test-532300303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3b47bead-2cd2-4f80-a8a3-27633c9aabed tempest-GroupsV320Test-532300303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3b47bead-2cd2-4f80-a8a3-27633c9aabed tempest-GroupsV320Test-532300303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:14 devstack sudo[94354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:12:14 devstack sudo[94354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:14 devstack sudo[94354]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3b47bead-2cd2-4f80-a8a3-27633c9aabed tempest-GroupsV320Test-532300303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.367s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:14 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3b47bead-2cd2-4f80-a8a3-27633c9aabed tempest-GroupsV320Test-532300303 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:12:14 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-3b47bead-2cd2-4f80-a8a3-27633c9aabed tempest-GroupsV320Test-532300303 None] Delete group completed successfully. Nov 03 13:12:24 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=84,cinder:INSERT=15,cinder:UPDATE=62,cinder:DELETE=5 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:12:24 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:UPDATE=72,cinder:SELECT=75,cinder:INSERT=12,cinder:DELETE=1 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:12:25 devstack sudo[94350]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3b1437f3-2d33-496b-b44e-d6f186377a2f" returned: 0 in 11.734s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:25 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd, size 1024.00 MB, duration 11.74 sec, destination /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3b1437f3-2d33-496b-b44e-d6f186377a2f {{(pid=86725) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:12:25 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Converted 1024.00 MB image at 87.24 MB/s Nov 03 13:12:25 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3b1437f3-2d33-496b-b44e-d6f186377a2f is being set with open permissions: ugo+rw Nov 03 13:12:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3b1437f3-2d33-496b-b44e-d6f186377a2f {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:25 devstack sudo[94396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3b1437f3-2d33-496b-b44e-d6f186377a2f Nov 03 13:12:25 devstack sudo[94396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:25 devstack sudo[94396]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3b1437f3-2d33-496b-b44e-d6f186377a2f" returned: 0 in 0.290s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Lock "cinder-quobyte-3b1437f3-2d33-496b-b44e-d6f186377a2f" released by "_copy_volume_from_snapshot" :: held 13.486s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:26 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Acquiring lock "cinder-quobyte-3912d2b0-e9bc-43a1-87b2-e269632b63f6" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:26 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Lock "cinder-quobyte-3912d2b0-e9bc-43a1-87b2-e269632b63f6" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Deleting offline snapshot 3912d2b0-e9bc-43a1-87b2-e269632b63f6 of volume 9f610ca6-0d62-4f2c-9708-7861a214f0dd {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:12:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] snapshot_file for this snap is: volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd.3912d2b0-e9bc-43a1-87b2-e269632b63f6 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:12:26 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[00edcf64-78aa-44e8-aa57-ff3b393dd613]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd.3912d2b0-e9bc-43a1-87b2-e269632b63f6 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:26 devstack sudo[94399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd.3912d2b0-e9bc-43a1-87b2-e269632b63f6 Nov 03 13:12:26 devstack sudo[94399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:26 devstack sudo[94399]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd.3912d2b0-e9bc-43a1-87b2-e269632b63f6" returned: 0 in 0.376s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:12:26 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae0f428-93eb-4df2-a1b7-a160a4e8ff55]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:26 devstack sudo[94404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd Nov 03 13:12:26 devstack sudo[94404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:27 devstack sudo[94404]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd" returned: 0 in 0.573s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd.3912d2b0-e9bc-43a1-87b2-e269632b63f6 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:27 devstack sudo[94411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd.3912d2b0-e9bc-43a1-87b2-e269632b63f6 Nov 03 13:12:27 devstack sudo[94411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:27 devstack sudo[94411]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd.3912d2b0-e9bc-43a1-87b2-e269632b63f6" returned: 0 in 0.567s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd.3912d2b0-e9bc-43a1-87b2-e269632b63f6 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:27 devstack sudo[94433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd.3912d2b0-e9bc-43a1-87b2-e269632b63f6 Nov 03 13:12:27 devstack sudo[94433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:27 devstack sudo[94433]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd.3912d2b0-e9bc-43a1-87b2-e269632b63f6" returned: 0 in 0.341s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:28 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Lock "cinder-quobyte-3912d2b0-e9bc-43a1-87b2-e269632b63f6" released by "_delete_snapshot" :: held 1.977s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.072s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18a4b695-eb80-427e-9f8a-1b6989e1cc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b1437f3-2d33-496b-b44e-d6f186377a2f', 'volume_size': 2, 'source_volid': '9f610ca6-0d62-4f2c-9708-7861a214f0dd', 'source_volstatus': 'available'}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20c74b4d-8cb5-4641-be61-a1941ef27ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:28 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Volume volume-3b1437f3-2d33-496b-b44e-d6f186377a2f (3b1437f3-2d33-496b-b44e-d6f186377a2f): created successfully Nov 03 13:12:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20c74b4d-8cb5-4641-be61-a1941ef27ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Flow 'volume_create_manager' (729df456-3037-48d0-9746-b88891e789a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:28 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-ad591409-a0ef-4a38-a273-43a73bdd7f8f tempest-VolumesCloneTest-979371548 None] Created volume successfully. Nov 03 13:12:28 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-ce22b714-2154-49a2-b3fa-7bb92b1a3505 req-55c400da-e5a4-46bb-8538-c88633c85c89 tempest-ServerActionsTestOtherA-2024956670 None] Terminate volume connection completed successfully. Nov 03 13:12:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-ce22b714-2154-49a2-b3fa-7bb92b1a3505 req-55c400da-e5a4-46bb-8538-c88633c85c89 tempest-ServerActionsTestOtherA-2024956670 None] Deleting attachment 7b46fbb4-5633-497e-b09d-ca2887acdce0. {{(pid=86725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:12:29 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-88328490-c2c8-4e45-a7ac-3894ad0644c5 tempest-VolumesCloneTest-979371548 None] Acquiring lock "cinder-3b1437f3-2d33-496b-b44e-d6f186377a2f-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:29 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-88328490-c2c8-4e45-a7ac-3894ad0644c5 tempest-VolumesCloneTest-979371548 None] Lock "cinder-3b1437f3-2d33-496b-b44e-d6f186377a2f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:29 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-88328490-c2c8-4e45-a7ac-3894ad0644c5 tempest-VolumesCloneTest-979371548 None] Acquiring lock "cinder-quobyte-3b1437f3-2d33-496b-b44e-d6f186377a2f" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:29 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-88328490-c2c8-4e45-a7ac-3894ad0644c5 tempest-VolumesCloneTest-979371548 None] Lock "cinder-quobyte-3b1437f3-2d33-496b-b44e-d6f186377a2f" acquired by "delete_volume" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:29 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1107e0-c229-4c75-acc5-a75d24c8886d]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-88328490-c2c8-4e45-a7ac-3894ad0644c5 tempest-VolumesCloneTest-979371548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3b1437f3-2d33-496b-b44e-d6f186377a2f {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:29 devstack sudo[94441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3b1437f3-2d33-496b-b44e-d6f186377a2f Nov 03 13:12:29 devstack sudo[94441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:29 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:12:29 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] Flow 'volume_create_manager' (b44f17c5-a62f-4139-a1b5-9c4c13a80e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:29 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7a7ad9-6455-4024-9c3f-b1ed5c0e36c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:29 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7a7ad9-6455-4024-9c3f-b1ed5c0e36c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1429527778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df335671-3489-48ff-bbaa-661bdd13b332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f35f1587a74a39865be4eec5f07507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:30Z,use_quota=True,user_id='e42c762f51c649aa91a0f3efa292160a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:29 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dabe2110-d3fa-4c30-9af2-fb1443aa5421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:29 devstack sudo[94441]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:29 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dabe2110-d3fa-4c30-9af2-fb1443aa5421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:29 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467a3aea-d73f-478f-90a0-6c46242e83d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:29 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467a3aea-d73f-478f-90a0-6c46242e83d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df335671-3489-48ff-bbaa-661bdd13b332', 'volume_name': 'volume-df335671-3489-48ff-bbaa-661bdd13b332', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:29 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee4436a0-2acd-43c4-aabb-3cb32fd465ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:29 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee4436a0-2acd-43c4-aabb-3cb32fd465ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:29 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d37dcaa-3fa1-438c-8b5f-1672ad3ec5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:29 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] Volume df335671-3489-48ff-bbaa-661bdd13b332: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df335671-3489-48ff-bbaa-661bdd13b332', 'volume_size': 1} Nov 03 13:12:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:29 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1429527778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df335671-3489-48ff-bbaa-661bdd13b332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f35f1587a74a39865be4eec5f07507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:30Z,use_quota=True,user_id='e42c762f51c649aa91a0f3efa292160a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:12:29 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] Creating volume df335671-3489-48ff-bbaa-661bdd13b332 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:12:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:29 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:29 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:29 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:12:29 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:12:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-88328490-c2c8-4e45-a7ac-3894ad0644c5 tempest-VolumesCloneTest-979371548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3b1437f3-2d33-496b-b44e-d6f186377a2f" returned: 0 in 0.633s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-88328490-c2c8-4e45-a7ac-3894ad0644c5 tempest-VolumesCloneTest-979371548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3b1437f3-2d33-496b-b44e-d6f186377a2f {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:29 devstack sudo[94464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332 1073741824 Nov 03 13:12:29 devstack sudo[94464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:29 devstack sudo[94467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3b1437f3-2d33-496b-b44e-d6f186377a2f Nov 03 13:12:29 devstack sudo[94467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:30 devstack sudo[94467]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-88328490-c2c8-4e45-a7ac-3894ad0644c5 tempest-VolumesCloneTest-979371548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3b1437f3-2d33-496b-b44e-d6f186377a2f" returned: 0 in 0.328s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:30 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-88328490-c2c8-4e45-a7ac-3894ad0644c5 tempest-VolumesCloneTest-979371548 None] Lock "cinder-quobyte-3b1437f3-2d33-496b-b44e-d6f186377a2f" released by "delete_volume" :: held 1.043s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:30 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-88328490-c2c8-4e45-a7ac-3894ad0644c5 tempest-VolumesCloneTest-979371548 None] Created reservations ['87e72aa4-ab69-4a6b-8543-8e5e62724506', '967aeaf8-e37b-444d-9f6c-35ac057bb07a', 'ac23af92-ff8a-4dcb-b0d2-54f69acfa64c', '5620c568-8bfa-4db7-991b-3f5cdda67fa3'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:12:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-88328490-c2c8-4e45-a7ac-3894ad0644c5 tempest-VolumesCloneTest-979371548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-88328490-c2c8-4e45-a7ac-3894ad0644c5 tempest-VolumesCloneTest-979371548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:30 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-88328490-c2c8-4e45-a7ac-3894ad0644c5 tempest-VolumesCloneTest-979371548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:30 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-88328490-c2c8-4e45-a7ac-3894ad0644c5 tempest-VolumesCloneTest-979371548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-88328490-c2c8-4e45-a7ac-3894ad0644c5 tempest-VolumesCloneTest-979371548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-88328490-c2c8-4e45-a7ac-3894ad0644c5 tempest-VolumesCloneTest-979371548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:30 devstack sudo[94478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:12:30 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:30 devstack sudo[94464]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332 1073741824" returned: 0 in 0.616s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:30 devstack sudo[94480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332 Nov 03 13:12:30 devstack sudo[94480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:30 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-88328490-c2c8-4e45-a7ac-3894ad0644c5 tempest-VolumesCloneTest-979371548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.298s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:30 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-88328490-c2c8-4e45-a7ac-3894ad0644c5 tempest-VolumesCloneTest-979371548 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:12:30 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-88328490-c2c8-4e45-a7ac-3894ad0644c5 tempest-VolumesCloneTest-979371548 None] Deleted volume successfully. Nov 03 13:12:30 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-88328490-c2c8-4e45-a7ac-3894ad0644c5 tempest-VolumesCloneTest-979371548 None] Lock "cinder-3b1437f3-2d33-496b-b44e-d6f186377a2f-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:30 devstack sudo[94480]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332" returned: 0 in 0.377s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:30 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:12:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d37dcaa-3fa1-438c-8b5f-1672ad3ec5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df335671-3489-48ff-bbaa-661bdd13b332', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88dfe0c3-bf6d-48aa-b7cb-507481d74877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:30 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] Volume volume-df335671-3489-48ff-bbaa-661bdd13b332 (df335671-3489-48ff-bbaa-661bdd13b332): created successfully Nov 03 13:12:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88dfe0c3-bf6d-48aa-b7cb-507481d74877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] Flow 'volume_create_manager' (b44f17c5-a62f-4139-a1b5-9c4c13a80e41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:30 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-5812ad5f-0451-4de0-bc5a-5e01e716b18e tempest-SnapshotsActionsTest-1901950821 None] Created volume successfully. Nov 03 13:12:31 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4fe7d8ee-e822-4797-bc27-88bfbd59019a tempest-VolumesCloneTest-979371548 None] Acquiring lock "cinder-9f610ca6-0d62-4f2c-9708-7861a214f0dd-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:31 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4fe7d8ee-e822-4797-bc27-88bfbd59019a tempest-VolumesCloneTest-979371548 None] Lock "cinder-9f610ca6-0d62-4f2c-9708-7861a214f0dd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:31 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4fe7d8ee-e822-4797-bc27-88bfbd59019a tempest-VolumesCloneTest-979371548 None] Acquiring lock "cinder-quobyte-9f610ca6-0d62-4f2c-9708-7861a214f0dd" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:31 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4fe7d8ee-e822-4797-bc27-88bfbd59019a tempest-VolumesCloneTest-979371548 None] Lock "cinder-quobyte-9f610ca6-0d62-4f2c-9708-7861a214f0dd" acquired by "delete_volume" :: waited 0.016s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:31 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[44763f55-a285-4b41-bacf-ace4a141834e]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4fe7d8ee-e822-4797-bc27-88bfbd59019a tempest-VolumesCloneTest-979371548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:31 devstack sudo[94487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd Nov 03 13:12:31 devstack sudo[94487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:31 devstack sudo[94487]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4fe7d8ee-e822-4797-bc27-88bfbd59019a tempest-VolumesCloneTest-979371548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd" returned: 0 in 0.443s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4fe7d8ee-e822-4797-bc27-88bfbd59019a tempest-VolumesCloneTest-979371548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:31 devstack sudo[94492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd Nov 03 13:12:31 devstack sudo[94492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-66a9acb1-f8c1-44c5-9b2e-982ac859d3f0 tempest-SnapshotsActionsTest-1901950821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-66a9acb1-f8c1-44c5-9b2e-982ac859d3f0 tempest-SnapshotsActionsTest-1901950821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:31 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-66a9acb1-f8c1-44c5-9b2e-982ac859d3f0 tempest-SnapshotsActionsTest-1901950821 None] Creating offline snapshot 795c6b09-433c-439c-970e-d5f5d37b0316 of volume df335671-3489-48ff-bbaa-661bdd13b332 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:12:32 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aed1133-f91a-47c8-8b69-fceba5bda587]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-66a9acb1-f8c1-44c5-9b2e-982ac859d3f0 tempest-SnapshotsActionsTest-1901950821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:32 devstack sudo[94494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332 Nov 03 13:12:32 devstack sudo[94494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:32 devstack sudo[94492]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4fe7d8ee-e822-4797-bc27-88bfbd59019a tempest-VolumesCloneTest-979371548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9f610ca6-0d62-4f2c-9708-7861a214f0dd" returned: 0 in 0.305s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:32 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4fe7d8ee-e822-4797-bc27-88bfbd59019a tempest-VolumesCloneTest-979371548 None] Lock "cinder-quobyte-9f610ca6-0d62-4f2c-9708-7861a214f0dd" released by "delete_volume" :: held 0.833s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:32 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-4fe7d8ee-e822-4797-bc27-88bfbd59019a tempest-VolumesCloneTest-979371548 None] Created reservations ['d90a1101-13e9-4fdb-ad5e-d2d26a066002', '020f41c6-192b-44e1-8c4e-8da43422507f', '971649e1-3b71-45b5-ae80-5c0f709a0c5e', '021f1eaa-f6a6-416a-bdd8-91429d067671'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:12:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4fe7d8ee-e822-4797-bc27-88bfbd59019a tempest-VolumesCloneTest-979371548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4fe7d8ee-e822-4797-bc27-88bfbd59019a tempest-VolumesCloneTest-979371548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:32 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4fe7d8ee-e822-4797-bc27-88bfbd59019a tempest-VolumesCloneTest-979371548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:32 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4fe7d8ee-e822-4797-bc27-88bfbd59019a tempest-VolumesCloneTest-979371548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4fe7d8ee-e822-4797-bc27-88bfbd59019a tempest-VolumesCloneTest-979371548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4fe7d8ee-e822-4797-bc27-88bfbd59019a tempest-VolumesCloneTest-979371548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:32 devstack sudo[94500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:12:32 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:32 devstack sudo[94494]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-66a9acb1-f8c1-44c5-9b2e-982ac859d3f0 tempest-SnapshotsActionsTest-1901950821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332" returned: 0 in 0.463s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-66a9acb1-f8c1-44c5-9b2e-982ac859d3f0 tempest-SnapshotsActionsTest-1901950821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:32 devstack sudo[94502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 1G Nov 03 13:12:32 devstack sudo[94502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:32 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4fe7d8ee-e822-4797-bc27-88bfbd59019a tempest-VolumesCloneTest-979371548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.302s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:32 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-4fe7d8ee-e822-4797-bc27-88bfbd59019a tempest-VolumesCloneTest-979371548 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:12:32 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-4fe7d8ee-e822-4797-bc27-88bfbd59019a tempest-VolumesCloneTest-979371548 None] Deleted volume successfully. Nov 03 13:12:32 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4fe7d8ee-e822-4797-bc27-88bfbd59019a tempest-VolumesCloneTest-979371548 None] Lock "cinder-9f610ca6-0d62-4f2c-9708-7861a214f0dd-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:33 devstack sudo[94502]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-66a9acb1-f8c1-44c5-9b2e-982ac859d3f0 tempest-SnapshotsActionsTest-1901950821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 1G" returned: 0 in 0.530s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-66a9acb1-f8c1-44c5-9b2e-982ac859d3f0 tempest-SnapshotsActionsTest-1901950821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df335671-3489-48ff-bbaa-661bdd13b332 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:33 devstack sudo[94509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df335671-3489-48ff-bbaa-661bdd13b332 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 Nov 03 13:12:33 devstack sudo[94509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:33 devstack sudo[94509]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-66a9acb1-f8c1-44c5-9b2e-982ac859d3f0 tempest-SnapshotsActionsTest-1901950821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df335671-3489-48ff-bbaa-661bdd13b332 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316" returned: 0 in 0.336s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:33 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-66a9acb1-f8c1-44c5-9b2e-982ac859d3f0 tempest-SnapshotsActionsTest-1901950821 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 is being set with open permissions: ugo+rw Nov 03 13:12:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-66a9acb1-f8c1-44c5-9b2e-982ac859d3f0 tempest-SnapshotsActionsTest-1901950821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:33 devstack sudo[94514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 Nov 03 13:12:33 devstack sudo[94514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:33 devstack sudo[94514]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-66a9acb1-f8c1-44c5-9b2e-982ac859d3f0 tempest-SnapshotsActionsTest-1901950821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316" returned: 0 in 0.328s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-66a9acb1-f8c1-44c5-9b2e-982ac859d3f0 tempest-SnapshotsActionsTest-1901950821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:33 devstack sudo[94517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.info Nov 03 13:12:33 devstack sudo[94517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:34 devstack sudo[94517]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-66a9acb1-f8c1-44c5-9b2e-982ac859d3f0 tempest-SnapshotsActionsTest-1901950821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.info" returned: 0 in 0.304s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:34 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-66a9acb1-f8c1-44c5-9b2e-982ac859d3f0 tempest-SnapshotsActionsTest-1901950821 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.info is being set with open permissions: ugo+rw Nov 03 13:12:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-66a9acb1-f8c1-44c5-9b2e-982ac859d3f0 tempest-SnapshotsActionsTest-1901950821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:34 devstack sudo[94520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.info Nov 03 13:12:34 devstack sudo[94520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:34 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:12:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Flow 'volume_create_manager' (60929353-998a-4df9-972d-ac5e6094429a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de9e0ac6-0825-4438-a2c9-b7103a48a185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de9e0ac6-0825-4438-a2c9-b7103a48a185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1795606099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ef6494c-6050-43f3-a045-8482e64733b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54276b007b194d47801cbf0d874f385c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:34Z,use_quota=True,user_id='e523d0d2aecd4f749b0b079cf25f3a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e0db34-9fc2-4cb1-8b23-5c7935224513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e0db34-9fc2-4cb1-8b23-5c7935224513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f52667-c336-4231-9750-5e8442b08626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:34 devstack cinder-volume[86725]: DEBUG cinder.image.glance [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Creating Keystone auth plugin from conf {{(pid=86725) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 13:12:34 devstack sudo[94520]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-66a9acb1-f8c1-44c5-9b2e-982ac859d3f0 tempest-SnapshotsActionsTest-1901950821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.info" returned: 0 in 0.312s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-66a9acb1-f8c1-44c5-9b2e-982ac859d3f0 tempest-SnapshotsActionsTest-1901950821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.407s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:34 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-66a9acb1-f8c1-44c5-9b2e-982ac859d3f0 tempest-SnapshotsActionsTest-1901950821 None] Create snapshot completed successfully Nov 03 13:12:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f52667-c336-4231-9750-5e8442b08626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4ef6494c-6050-43f3-a045-8482e64733b0', 'volume_name': 'volume-4ef6494c-6050-43f3-a045-8482e64733b0', 'volume_size': 1, 'image_id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8a9fdfe427f436894d9c81085f9b6d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'created_at': datetime.datetime(2026, 11, 3, 12, 0, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 0, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3fd60c4-a442-439e-84b9-7c1143e6eca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3fd60c4-a442-439e-84b9-7c1143e6eca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ff0a6d5-c17c-4401-9764-5726a69138ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:34 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Volume 4ef6494c-6050-43f3-a045-8482e64733b0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4ef6494c-6050-43f3-a045-8482e64733b0', 'volume_size': 1, 'image_id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8a9fdfe427f436894d9c81085f9b6d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'created_at': datetime.datetime(2026, 11, 3, 12, 0, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 0, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 13:12:34 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Trying to clone 4ef6494c-6050-43f3-a045-8482e64733b0 from image d23bcc2f-7dfc-45dc-b259-aec67f909b4f at location (None, [{'url': 'file:///opt/stack/data/glance/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'metadata': {}}]). {{(pid=86725) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 13:12:35 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_wrfen4lfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86725) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 13:12:35 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Image download 20.69 MB at 20.69 MB/s Nov 03 13:12:35 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dae4463-ce2e-4e23-ae80-b1af561b402b]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_wrfen4lfdevstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:35 devstack sudo[94524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_wrfen4lfdevstack@QuobyteHD Nov 03 13:12:35 devstack sudo[94524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:35 devstack sudo[94524]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_wrfen4lfdevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:35 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Temporary image d23bcc2f-7dfc-45dc-b259-aec67f909b4f is fetched for user e523d0d2aecd4f749b0b079cf25f3a42. {{(pid=86725) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 13:12:35 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ccb8fc-acb3-4198-9368-994bf00dddc9]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_wrfen4lfdevstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:35 devstack sudo[94530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_wrfen4lfdevstack@QuobyteHD Nov 03 13:12:35 devstack sudo[94530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c47339e2-17a4-4f04-8803-5cb2e6d1fae2 tempest-SnapshotsActionsTest-1901950821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c47339e2-17a4-4f04-8803-5cb2e6d1fae2 tempest-SnapshotsActionsTest-1901950821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-c47339e2-17a4-4f04-8803-5cb2e6d1fae2 tempest-SnapshotsActionsTest-1901950821 None] Creating offline snapshot 8de4d8ce-e3e2-403d-9b73-3ceaf220094a of volume df335671-3489-48ff-bbaa-661bdd13b332 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:12:36 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[63806ce4-7218-4d1c-bc84-e5e1f966a66e]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c47339e2-17a4-4f04-8803-5cb2e6d1fae2 tempest-SnapshotsActionsTest-1901950821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:36 devstack sudo[94530]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_wrfen4lfdevstack@QuobyteHD" returned: 0 in 0.497s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:36 devstack sudo[94535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 Nov 03 13:12:36 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:36 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c47339e2-17a4-4f04-8803-5cb2e6d1fae2 tempest-SnapshotsActionsTest-1901950821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316" returned: 0 in 0.425s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-c47339e2-17a4-4f04-8803-5cb2e6d1fae2 tempest-SnapshotsActionsTest-1901950821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df335671-3489-48ff-bbaa-661bdd13b332(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:12:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c47339e2-17a4-4f04-8803-5cb2e6d1fae2 tempest-SnapshotsActionsTest-1901950821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.8de4d8ce-e3e2-403d-9b73-3ceaf220094a 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:36 devstack sudo[94540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.8de4d8ce-e3e2-403d-9b73-3ceaf220094a 1G Nov 03 13:12:36 devstack sudo[94540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:37 devstack sudo[94540]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c47339e2-17a4-4f04-8803-5cb2e6d1fae2 tempest-SnapshotsActionsTest-1901950821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.8de4d8ce-e3e2-403d-9b73-3ceaf220094a 1G" returned: 0 in 0.553s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c47339e2-17a4-4f04-8803-5cb2e6d1fae2 tempest-SnapshotsActionsTest-1901950821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.8de4d8ce-e3e2-403d-9b73-3ceaf220094a {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:37 devstack sudo[94546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.8de4d8ce-e3e2-403d-9b73-3ceaf220094a Nov 03 13:12:37 devstack sudo[94546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:37 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:12:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] Flow 'volume_create_manager' (a82a6697-8249-4e5b-b504-c0721e8cabf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6629baa6-65e4-4cf9-9def-8e27856ca168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6629baa6-65e4-4cf9-9def-8e27856ca168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1554525020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4314f99b-fca6-47a7-abd5-50cc0ff7388e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9522a11a75cf44bc84765823c173de83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:37Z,use_quota=True,user_id='fd4dfb10072d401385a629c2ba422dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9dab118-ed00-4b6b-b4de-71dd587f3889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9dab118-ed00-4b6b-b4de-71dd587f3889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bfeb0d3-4496-4774-a3a4-fa53132ef272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bfeb0d3-4496-4774-a3a4-fa53132ef272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4314f99b-fca6-47a7-abd5-50cc0ff7388e', 'volume_name': 'volume-4314f99b-fca6-47a7-abd5-50cc0ff7388e', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f12957-8370-44d9-a67c-8596d0f44831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f12957-8370-44d9-a67c-8596d0f44831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a2fa7b-f860-421c-b6b9-7198ff252a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:37 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] Volume 4314f99b-fca6-47a7-abd5-50cc0ff7388e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4314f99b-fca6-47a7-abd5-50cc0ff7388e', 'volume_size': 1} Nov 03 13:12:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:37 devstack sudo[94546]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c47339e2-17a4-4f04-8803-5cb2e6d1fae2 tempest-SnapshotsActionsTest-1901950821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.8de4d8ce-e3e2-403d-9b73-3ceaf220094a" returned: 0 in 0.289s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:37 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-c47339e2-17a4-4f04-8803-5cb2e6d1fae2 tempest-SnapshotsActionsTest-1901950821 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.8de4d8ce-e3e2-403d-9b73-3ceaf220094a is being set with open permissions: ugo+rw Nov 03 13:12:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c47339e2-17a4-4f04-8803-5cb2e6d1fae2 tempest-SnapshotsActionsTest-1901950821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.8de4d8ce-e3e2-403d-9b73-3ceaf220094a {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:37 devstack sudo[94551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.8de4d8ce-e3e2-403d-9b73-3ceaf220094a Nov 03 13:12:37 devstack sudo[94551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:37 devstack sudo[94551]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c47339e2-17a4-4f04-8803-5cb2e6d1fae2 tempest-SnapshotsActionsTest-1901950821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.8de4d8ce-e3e2-403d-9b73-3ceaf220094a" returned: 0 in 0.250s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c47339e2-17a4-4f04-8803-5cb2e6d1fae2 tempest-SnapshotsActionsTest-1901950821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.653s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.526s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:37 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1795606099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ef6494c-6050-43f3-a045-8482e64733b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54276b007b194d47801cbf0d874f385c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:34Z,use_quota=True,user_id='e523d0d2aecd4f749b0b079cf25f3a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:12:37 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Creating volume 4ef6494c-6050-43f3-a045-8482e64733b0 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:12:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:37 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:37 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:37 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:12:37 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:12:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4ef6494c-6050-43f3-a045-8482e64733b0 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:37 devstack sudo[94554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4ef6494c-6050-43f3-a045-8482e64733b0 1073741824 Nov 03 13:12:37 devstack sudo[94554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:37 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-c47339e2-17a4-4f04-8803-5cb2e6d1fae2 tempest-SnapshotsActionsTest-1901950821 None] Create snapshot completed successfully Nov 03 13:12:38 devstack sudo[94554]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4ef6494c-6050-43f3-a045-8482e64733b0 1073741824" returned: 0 in 0.432s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4ef6494c-6050-43f3-a045-8482e64733b0 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:38 devstack sudo[94560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4ef6494c-6050-43f3-a045-8482e64733b0 Nov 03 13:12:38 devstack sudo[94560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:38 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e2a0e31d-5dc6-4adf-8a17-98861e065bc8 tempest-SnapshotsActionsTest-1540369714 None] Acquiring lock "cinder-8de4d8ce-e3e2-403d-9b73-3ceaf220094a-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:38 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e2a0e31d-5dc6-4adf-8a17-98861e065bc8 tempest-SnapshotsActionsTest-1540369714 None] Lock "cinder-8de4d8ce-e3e2-403d-9b73-3ceaf220094a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:38 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e2a0e31d-5dc6-4adf-8a17-98861e065bc8 tempest-SnapshotsActionsTest-1540369714 None] Acquiring lock "cinder-quobyte-df335671-3489-48ff-bbaa-661bdd13b332" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:38 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e2a0e31d-5dc6-4adf-8a17-98861e065bc8 tempest-SnapshotsActionsTest-1540369714 None] Lock "cinder-quobyte-df335671-3489-48ff-bbaa-661bdd13b332" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:38 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e2a0e31d-5dc6-4adf-8a17-98861e065bc8 tempest-SnapshotsActionsTest-1540369714 None] Acquiring lock "cinder-quobyte-8de4d8ce-e3e2-403d-9b73-3ceaf220094a" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:38 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e2a0e31d-5dc6-4adf-8a17-98861e065bc8 tempest-SnapshotsActionsTest-1540369714 None] Lock "cinder-quobyte-8de4d8ce-e3e2-403d-9b73-3ceaf220094a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:38 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-e2a0e31d-5dc6-4adf-8a17-98861e065bc8 tempest-SnapshotsActionsTest-1540369714 None] Deleting offline snapshot 8de4d8ce-e3e2-403d-9b73-3ceaf220094a of volume df335671-3489-48ff-bbaa-661bdd13b332 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:12:38 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-e2a0e31d-5dc6-4adf-8a17-98861e065bc8 tempest-SnapshotsActionsTest-1540369714 None] snapshot_file for this snap is: volume-df335671-3489-48ff-bbaa-661bdd13b332.8de4d8ce-e3e2-403d-9b73-3ceaf220094a {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:12:38 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24c79e1-ef23-4b58-8903-15ee6089f4dd]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e2a0e31d-5dc6-4adf-8a17-98861e065bc8 tempest-SnapshotsActionsTest-1540369714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.8de4d8ce-e3e2-403d-9b73-3ceaf220094a {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:38 devstack sudo[94560]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4ef6494c-6050-43f3-a045-8482e64733b0" returned: 0 in 0.267s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:38 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:12:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.202s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:38 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1554525020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4314f99b-fca6-47a7-abd5-50cc0ff7388e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9522a11a75cf44bc84765823c173de83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:37Z,use_quota=True,user_id='fd4dfb10072d401385a629c2ba422dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:12:38 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] Creating volume 4314f99b-fca6-47a7-abd5-50cc0ff7388e {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:12:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:38 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:38 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:38 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:12:38 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:12:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4314f99b-fca6-47a7-abd5-50cc0ff7388e 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:38 devstack sudo[94562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.8de4d8ce-e3e2-403d-9b73-3ceaf220094a Nov 03 13:12:38 devstack sudo[94562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:38 devstack sudo[94564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4314f99b-fca6-47a7-abd5-50cc0ff7388e 1073741824 Nov 03 13:12:38 devstack sudo[94564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:38 devstack cinder-volume[86725]: DEBUG cinder.volume.volume_utils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Attempting download of d23bcc2f-7dfc-45dc-b259-aec67f909b4f ((None, [{'url': 'file:///opt/stack/data/glance/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'metadata': {}}])) to volume 4ef6494c-6050-43f3-a045-8482e64733b0. {{(pid=86725) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 13:12:38 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[2422432f-9640-4092-a5f1-980171f7070a]: (4, 'raw') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_tonbyasv {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:38 devstack sudo[94567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_tonbyasv Nov 03 13:12:38 devstack sudo[94567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:38 devstack sudo[94562]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e2a0e31d-5dc6-4adf-8a17-98861e065bc8 tempest-SnapshotsActionsTest-1540369714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.8de4d8ce-e3e2-403d-9b73-3ceaf220094a" returned: 0 in 0.409s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:38 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-e2a0e31d-5dc6-4adf-8a17-98861e065bc8 tempest-SnapshotsActionsTest-1540369714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df335671-3489-48ff-bbaa-661bdd13b332(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:12:38 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5bc721-d5cd-477d-9e31-e471457ef4a0]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e2a0e31d-5dc6-4adf-8a17-98861e065bc8 tempest-SnapshotsActionsTest-1540369714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:38 devstack sudo[94567]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_tonbyasv" returned: 0 in 0.345s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_tonbyasv {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:38 devstack sudo[94578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 Nov 03 13:12:39 devstack sudo[94578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:39 devstack sudo[94564]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4314f99b-fca6-47a7-abd5-50cc0ff7388e 1073741824" returned: 0 in 0.525s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:39 devstack sudo[94581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_tonbyasv Nov 03 13:12:39 devstack sudo[94581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4314f99b-fca6-47a7-abd5-50cc0ff7388e {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:39 devstack sudo[94584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4314f99b-fca6-47a7-abd5-50cc0ff7388e Nov 03 13:12:39 devstack sudo[94584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:39 devstack sudo[94578]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e2a0e31d-5dc6-4adf-8a17-98861e065bc8 tempest-SnapshotsActionsTest-1540369714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316" returned: 0 in 0.463s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-e2a0e31d-5dc6-4adf-8a17-98861e065bc8 tempest-SnapshotsActionsTest-1540369714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df335671-3489-48ff-bbaa-661bdd13b332(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e2a0e31d-5dc6-4adf-8a17-98861e065bc8 tempest-SnapshotsActionsTest-1540369714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.8de4d8ce-e3e2-403d-9b73-3ceaf220094a {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:39 devstack sudo[94581]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_tonbyasv" returned: 1 in 0.408s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_tonbyasv' failed. Not Retrying. {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:12:39 devstack sudo[94591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.8de4d8ce-e3e2-403d-9b73-3ceaf220094a Nov 03 13:12:39 devstack sudo[94591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bac83f8-17f2-49c0-aff8-039493eb7d5f]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_wrfen4lfdevstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:39 devstack sudo[94584]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4314f99b-fca6-47a7-abd5-50cc0ff7388e" returned: 0 in 0.405s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a2fa7b-f860-421c-b6b9-7198ff252a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4314f99b-fca6-47a7-abd5-50cc0ff7388e', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f77f83eb-b0d6-46da-9262-eec31606af97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:39 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] Volume volume-4314f99b-fca6-47a7-abd5-50cc0ff7388e (4314f99b-fca6-47a7-abd5-50cc0ff7388e): created successfully Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f77f83eb-b0d6-46da-9262-eec31606af97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] Flow 'volume_create_manager' (a82a6697-8249-4e5b-b504-c0721e8cabf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:39 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-28451f6d-b429-4e22-b2ee-06c44d90774b tempest-VolumesGetTest-2074296944 None] Created volume successfully. Nov 03 13:12:39 devstack sudo[94593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_wrfen4lfdevstack@QuobyteHD Nov 03 13:12:39 devstack sudo[94593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] Flow 'volume_create_manager' (4164390e-5151-46fc-b9a1-0e1efc4a150f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccd4de61-9fe0-491a-9f46-797ab5b4733b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccd4de61-9fe0-491a-9f46-797ab5b4733b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-410944855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9417f773-0a02-4288-8e3c-f585c15b8d82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19794791f1e2414ba57edb38242a425d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:40Z,use_quota=True,user_id='43d0b310bf30429f9651d28912576de7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e2cb8fa-82a9-434d-80e6-ebd2517a46f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e2cb8fa-82a9-434d-80e6-ebd2517a46f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd4196e9-f46c-4fa1-85a9-c6262661ae77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd4196e9-f46c-4fa1-85a9-c6262661ae77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9417f773-0a02-4288-8e3c-f585c15b8d82', 'volume_name': 'volume-9417f773-0a02-4288-8e3c-f585c15b8d82', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f98fe4ef-0c9f-421d-bfa4-237de1e84dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f98fe4ef-0c9f-421d-bfa4-237de1e84dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (107cb13b-7054-479c-9f69-da234be03fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:39 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] Volume 9417f773-0a02-4288-8e3c-f585c15b8d82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9417f773-0a02-4288-8e3c-f585c15b8d82', 'volume_size': 1} Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-410944855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9417f773-0a02-4288-8e3c-f585c15b8d82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19794791f1e2414ba57edb38242a425d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:40Z,use_quota=True,user_id='43d0b310bf30429f9651d28912576de7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] Creating volume 9417f773-0a02-4288-8e3c-f585c15b8d82 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:12:39 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9417f773-0a02-4288-8e3c-f585c15b8d82 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:39 devstack sudo[94599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9417f773-0a02-4288-8e3c-f585c15b8d82 1073741824 Nov 03 13:12:39 devstack sudo[94599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:39 devstack sudo[94593]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_wrfen4lfdevstack@QuobyteHD" returned: 0 in 0.437s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] d23bcc2f-7dfc-45dc-b259-aec67f909b4f was qcow2, converting to qcow2 {{(pid=86725) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 13:12:39 devstack sudo[94591]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_wrfen4lfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4ef6494c-6050-43f3-a045-8482e64733b0 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e2a0e31d-5dc6-4adf-8a17-98861e065bc8 tempest-SnapshotsActionsTest-1540369714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.8de4d8ce-e3e2-403d-9b73-3ceaf220094a" returned: 0 in 0.487s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e2a0e31d-5dc6-4adf-8a17-98861e065bc8 tempest-SnapshotsActionsTest-1540369714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.8de4d8ce-e3e2-403d-9b73-3ceaf220094a {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:39 devstack sudo[94604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_wrfen4lfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4ef6494c-6050-43f3-a045-8482e64733b0 Nov 03 13:12:39 devstack sudo[94604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:39 devstack sudo[94605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.8de4d8ce-e3e2-403d-9b73-3ceaf220094a Nov 03 13:12:39 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:40 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e2a0e31d-5dc6-4adf-8a17-98861e065bc8 tempest-SnapshotsActionsTest-1540369714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.8de4d8ce-e3e2-403d-9b73-3ceaf220094a" returned: 0 in 0.264s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:40 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e2a0e31d-5dc6-4adf-8a17-98861e065bc8 tempest-SnapshotsActionsTest-1540369714 None] Lock "cinder-quobyte-8de4d8ce-e3e2-403d-9b73-3ceaf220094a" released by "_delete_snapshot" :: held 1.744s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:40 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e2a0e31d-5dc6-4adf-8a17-98861e065bc8 tempest-SnapshotsActionsTest-1540369714 None] Lock "cinder-quobyte-df335671-3489-48ff-bbaa-661bdd13b332" released by "delete_snapshot" :: held 1.770s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:40 devstack sudo[94599]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9417f773-0a02-4288-8e3c-f585c15b8d82 1073741824" returned: 0 in 0.450s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9417f773-0a02-4288-8e3c-f585c15b8d82 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:40 devstack sudo[94617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9417f773-0a02-4288-8e3c-f585c15b8d82 Nov 03 13:12:40 devstack sudo[94617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:40 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-e2a0e31d-5dc6-4adf-8a17-98861e065bc8 tempest-SnapshotsActionsTest-1540369714 None] Created reservations ['e4d54ae9-2dbb-425e-a69f-23c6c6fa3064', '967a8c1a-3e09-40fb-829d-60bdb8f6afa9', '4e60e706-1d7b-49a9-a39b-42c45f378921', '6feb4a6d-0d0e-4fa2-8d60-9ed5f97fb81b'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:12:40 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-e2a0e31d-5dc6-4adf-8a17-98861e065bc8 tempest-SnapshotsActionsTest-1540369714 None] Delete snapshot completed successfully. Nov 03 13:12:40 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e2a0e31d-5dc6-4adf-8a17-98861e065bc8 tempest-SnapshotsActionsTest-1540369714 None] Lock "cinder-8de4d8ce-e3e2-403d-9b73-3ceaf220094a-delete_snapshot" released by "delete_snapshot" :: held 1.999s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:40 devstack sudo[94617]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9417f773-0a02-4288-8e3c-f585c15b8d82" returned: 0 in 0.338s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:40 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:12:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:40 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (107cb13b-7054-479c-9f69-da234be03fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9417f773-0a02-4288-8e3c-f585c15b8d82', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:40 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d73bb46-8b37-4350-a415-f93704b0031c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:40 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] Volume volume-9417f773-0a02-4288-8e3c-f585c15b8d82 (9417f773-0a02-4288-8e3c-f585c15b8d82): created successfully Nov 03 13:12:40 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d73bb46-8b37-4350-a415-f93704b0031c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:40 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] Flow 'volume_create_manager' (4164390e-5151-46fc-b9a1-0e1efc4a150f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:40 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-0cfc25ff-4532-49a7-9e9a-73de20c29152 tempest-AttachVolumeNegativeTest-621359088 None] Created volume successfully. Nov 03 13:12:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4f7d7ce6-8a3a-4b94-9a94-315f59c55a90 tempest-SnapshotsActionsTest-1901950821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4f7d7ce6-8a3a-4b94-9a94-315f59c55a90 tempest-SnapshotsActionsTest-1901950821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:40 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-4f7d7ce6-8a3a-4b94-9a94-315f59c55a90 tempest-SnapshotsActionsTest-1901950821 None] Creating offline snapshot 36d10315-b243-44c9-be33-0f98bf83eea4 of volume df335671-3489-48ff-bbaa-661bdd13b332 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:12:40 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c9ffcc-f1a5-4e2c-b530-697abe6a5dae]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4f7d7ce6-8a3a-4b94-9a94-315f59c55a90 tempest-SnapshotsActionsTest-1901950821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:41 devstack sudo[94623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 Nov 03 13:12:41 devstack sudo[94623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:41 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:12:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] Flow 'volume_create_manager' (e4d8ec02-0e35-43e3-86d3-26e5469355de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d61b344-1922-44b1-9a95-e2bc03241cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d61b344-1922-44b1-9a95-e2bc03241cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2145333925',display_name='tempest-VolumesGetTest-Volume-1376540527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ddbfc38-b4eb-435d-843d-2a918dc2fb14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9522a11a75cf44bc84765823c173de83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:41Z,use_quota=True,user_id='fd4dfb10072d401385a629c2ba422dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3383937a-697f-456c-820d-426468678a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3383937a-697f-456c-820d-426468678a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e726b036-9085-4c7c-a09d-6ffd0bc5eee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e726b036-9085-4c7c-a09d-6ffd0bc5eee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ddbfc38-b4eb-435d-843d-2a918dc2fb14', 'volume_name': 'volume-4ddbfc38-b4eb-435d-843d-2a918dc2fb14', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f83d06ff-d2e4-45e2-9b92-1016ed929bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f83d06ff-d2e4-45e2-9b92-1016ed929bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5581a7a-bc2c-4b07-9731-355f580029dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:41 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] Volume 4ddbfc38-b4eb-435d-843d-2a918dc2fb14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ddbfc38-b4eb-435d-843d-2a918dc2fb14', 'volume_size': 1} Nov 03 13:12:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:41 devstack sudo[94623]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4f7d7ce6-8a3a-4b94-9a94-315f59c55a90 tempest-SnapshotsActionsTest-1901950821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316" returned: 0 in 0.471s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:41 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-4f7d7ce6-8a3a-4b94-9a94-315f59c55a90 tempest-SnapshotsActionsTest-1901950821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df335671-3489-48ff-bbaa-661bdd13b332(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:12:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4f7d7ce6-8a3a-4b94-9a94-315f59c55a90 tempest-SnapshotsActionsTest-1901950821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.36d10315-b243-44c9-be33-0f98bf83eea4 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:41 devstack sudo[94629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.36d10315-b243-44c9-be33-0f98bf83eea4 1G Nov 03 13:12:41 devstack sudo[94629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:42 devstack sudo[94629]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4f7d7ce6-8a3a-4b94-9a94-315f59c55a90 tempest-SnapshotsActionsTest-1901950821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.36d10315-b243-44c9-be33-0f98bf83eea4 1G" returned: 0 in 0.581s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4f7d7ce6-8a3a-4b94-9a94-315f59c55a90 tempest-SnapshotsActionsTest-1901950821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.36d10315-b243-44c9-be33-0f98bf83eea4 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:42 devstack sudo[94604]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_wrfen4lfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4ef6494c-6050-43f3-a045-8482e64733b0" returned: 0 in 2.266s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:42 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_wrfen4lfdevstack@QuobyteHD, size 112.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4ef6494c-6050-43f3-a045-8482e64733b0 {{(pid=86725) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:12:42 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Converted 112.00 MB image at 49.38 MB/s Nov 03 13:12:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4ef6494c-6050-43f3-a045-8482e64733b0 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:42 devstack sudo[94639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.36d10315-b243-44c9-be33-0f98bf83eea4 Nov 03 13:12:42 devstack sudo[94639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:42 devstack sudo[94640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4ef6494c-6050-43f3-a045-8482e64733b0 1G Nov 03 13:12:42 devstack sudo[94640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:42 devstack sudo[94639]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4f7d7ce6-8a3a-4b94-9a94-315f59c55a90 tempest-SnapshotsActionsTest-1901950821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.36d10315-b243-44c9-be33-0f98bf83eea4" returned: 0 in 0.350s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:42 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-4f7d7ce6-8a3a-4b94-9a94-315f59c55a90 tempest-SnapshotsActionsTest-1901950821 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.36d10315-b243-44c9-be33-0f98bf83eea4 is being set with open permissions: ugo+rw Nov 03 13:12:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4f7d7ce6-8a3a-4b94-9a94-315f59c55a90 tempest-SnapshotsActionsTest-1901950821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.36d10315-b243-44c9-be33-0f98bf83eea4 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:42 devstack sudo[94658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.36d10315-b243-44c9-be33-0f98bf83eea4 Nov 03 13:12:42 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:42 devstack sudo[94640]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4ef6494c-6050-43f3-a045-8482e64733b0 1G" returned: 0 in 0.388s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:42 devstack cinder-volume[86725]: DEBUG cinder.volume.volume_utils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Downloaded image d23bcc2f-7dfc-45dc-b259-aec67f909b4f ((None, [{'url': 'file:///opt/stack/data/glance/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'metadata': {}}])) to volume 4ef6494c-6050-43f3-a045-8482e64733b0 successfully. {{(pid=86725) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 13:12:42 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Temporary image d23bcc2f-7dfc-45dc-b259-aec67f909b4f for user e523d0d2aecd4f749b0b079cf25f3a42 is deleted. {{(pid=86725) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 13:12:42 devstack cinder-volume[86725]: DEBUG cinder.volume.volume_utils [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Marking volume 4ef6494c-6050-43f3-a045-8482e64733b0 as bootable. {{(pid=86725) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 13:12:42 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Copying metadata from image d23bcc2f-7dfc-45dc-b259-aec67f909b4f to 4ef6494c-6050-43f3-a045-8482e64733b0. {{(pid=86725) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 13:12:42 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Creating volume glance metadata for volume 4ef6494c-6050-43f3-a045-8482e64733b0 backed by image d23bcc2f-7dfc-45dc-b259-aec67f909b4f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86725) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 13:12:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-82cecf81-9816-4641-bee0-f4654057ab76 req-26bba344-5ec7-42e4-a943-fa09d77cd69d tempest-AttachVolumeNegativeTest-621359088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ff0a6d5-c17c-4401-9764-5726a69138ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ef6494c-6050-43f3-a045-8482e64733b0', 'volume_size': 1, 'image_id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8a9fdfe427f436894d9c81085f9b6d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'created_at': datetime.datetime(2026, 11, 3, 12, 0, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 0, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac4546b-6dae-4eb2-ba54-c64e31ebebb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:42 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Volume volume-4ef6494c-6050-43f3-a045-8482e64733b0 (4ef6494c-6050-43f3-a045-8482e64733b0): created successfully Nov 03 13:12:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac4546b-6dae-4eb2-ba54-c64e31ebebb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Flow 'volume_create_manager' (60929353-998a-4df9-972d-ac5e6094429a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:42 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-29c482bd-eb9c-4e8b-b5e2-5faec9b37f41 tempest-ServerActionsTestOtherA-2024956670 None] Created volume successfully. Nov 03 13:12:42 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4f7d7ce6-8a3a-4b94-9a94-315f59c55a90 tempest-SnapshotsActionsTest-1901950821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.36d10315-b243-44c9-be33-0f98bf83eea4" returned: 0 in 0.245s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4f7d7ce6-8a3a-4b94-9a94-315f59c55a90 tempest-SnapshotsActionsTest-1901950821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.770s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.335s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:42 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2145333925',display_name='tempest-VolumesGetTest-Volume-1376540527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ddbfc38-b4eb-435d-843d-2a918dc2fb14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9522a11a75cf44bc84765823c173de83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:41Z,use_quota=True,user_id='fd4dfb10072d401385a629c2ba422dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:12:42 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] Creating volume 4ddbfc38-b4eb-435d-843d-2a918dc2fb14 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:12:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:42 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:42 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:42 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:12:42 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:12:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4ddbfc38-b4eb-435d-843d-2a918dc2fb14 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:42 devstack sudo[94661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4ddbfc38-b4eb-435d-843d-2a918dc2fb14 1073741824 Nov 03 13:12:42 devstack sudo[94661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:42 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-4f7d7ce6-8a3a-4b94-9a94-315f59c55a90 tempest-SnapshotsActionsTest-1901950821 None] Create snapshot completed successfully Nov 03 13:12:43 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3d37aa02-f511-49e9-b6e4-28e4f8ab03d6 tempest-SnapshotsActionsTest-1540369714 None] Acquiring lock "cinder-36d10315-b243-44c9-be33-0f98bf83eea4-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:43 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3d37aa02-f511-49e9-b6e4-28e4f8ab03d6 tempest-SnapshotsActionsTest-1540369714 None] Lock "cinder-36d10315-b243-44c9-be33-0f98bf83eea4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:43 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3d37aa02-f511-49e9-b6e4-28e4f8ab03d6 tempest-SnapshotsActionsTest-1540369714 None] Acquiring lock "cinder-quobyte-df335671-3489-48ff-bbaa-661bdd13b332" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:43 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3d37aa02-f511-49e9-b6e4-28e4f8ab03d6 tempest-SnapshotsActionsTest-1540369714 None] Lock "cinder-quobyte-df335671-3489-48ff-bbaa-661bdd13b332" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:43 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3d37aa02-f511-49e9-b6e4-28e4f8ab03d6 tempest-SnapshotsActionsTest-1540369714 None] Acquiring lock "cinder-quobyte-36d10315-b243-44c9-be33-0f98bf83eea4" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:43 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3d37aa02-f511-49e9-b6e4-28e4f8ab03d6 tempest-SnapshotsActionsTest-1540369714 None] Lock "cinder-quobyte-36d10315-b243-44c9-be33-0f98bf83eea4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:43 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-3d37aa02-f511-49e9-b6e4-28e4f8ab03d6 tempest-SnapshotsActionsTest-1540369714 None] Deleting offline snapshot 36d10315-b243-44c9-be33-0f98bf83eea4 of volume df335671-3489-48ff-bbaa-661bdd13b332 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:12:43 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-3d37aa02-f511-49e9-b6e4-28e4f8ab03d6 tempest-SnapshotsActionsTest-1540369714 None] snapshot_file for this snap is: volume-df335671-3489-48ff-bbaa-661bdd13b332.36d10315-b243-44c9-be33-0f98bf83eea4 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:12:43 devstack sudo[94661]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4ddbfc38-b4eb-435d-843d-2a918dc2fb14 1073741824" returned: 0 in 0.605s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:43 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6fa82b-b74c-45e7-a371-8110017b4bb5]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3d37aa02-f511-49e9-b6e4-28e4f8ab03d6 tempest-SnapshotsActionsTest-1540369714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.36d10315-b243-44c9-be33-0f98bf83eea4 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4ddbfc38-b4eb-435d-843d-2a918dc2fb14 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:43 devstack sudo[94703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4ddbfc38-b4eb-435d-843d-2a918dc2fb14 Nov 03 13:12:43 devstack sudo[94703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:43 devstack sudo[94702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.36d10315-b243-44c9-be33-0f98bf83eea4 Nov 03 13:12:43 devstack sudo[94702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:43 devstack sudo[94703]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4ddbfc38-b4eb-435d-843d-2a918dc2fb14" returned: 0 in 0.284s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:43 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:12:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-82cecf81-9816-4641-bee0-f4654057ab76 req-26bba344-5ec7-42e4-a943-fa09d77cd69d tempest-AttachVolumeNegativeTest-621359088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.171s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-82cecf81-9816-4641-bee0-f4654057ab76 req-26bba344-5ec7-42e4-a943-fa09d77cd69d tempest-AttachVolumeNegativeTest-621359088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5581a7a-bc2c-4b07-9731-355f580029dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ddbfc38-b4eb-435d-843d-2a918dc2fb14', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e91a41f-26f0-4000-b2c8-62fc7a0e461b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:43 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] Volume volume-4ddbfc38-b4eb-435d-843d-2a918dc2fb14 (4ddbfc38-b4eb-435d-843d-2a918dc2fb14): created successfully Nov 03 13:12:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e91a41f-26f0-4000-b2c8-62fc7a0e461b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] Flow 'volume_create_manager' (e4d8ec02-0e35-43e3-86d3-26e5469355de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-82cecf81-9816-4641-bee0-f4654057ab76 req-26bba344-5ec7-42e4-a943-fa09d77cd69d tempest-AttachVolumeNegativeTest-621359088 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43', 'name': 'volume-9417f773-0a02-4288-8e3c-f585c15b8d82', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a394840c-512c-48e2-90f5-79be9e012925', 'enforce_multipath': True} {{(pid=86725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:12:43 devstack sudo[94702]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3d37aa02-f511-49e9-b6e4-28e4f8ab03d6 tempest-SnapshotsActionsTest-1540369714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.36d10315-b243-44c9-be33-0f98bf83eea4" returned: 0 in 0.474s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:43 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-3d37aa02-f511-49e9-b6e4-28e4f8ab03d6 tempest-SnapshotsActionsTest-1540369714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df335671-3489-48ff-bbaa-661bdd13b332(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:12:43 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[66191c9f-70e8-4115-9ea5-b7ad8f97ad04]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:43 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-ea57ece7-c22b-4a19-85b0-7fe61a1ddad2 tempest-VolumesGetTest-2074296944 None] Created volume successfully. Nov 03 13:12:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3d37aa02-f511-49e9-b6e4-28e4f8ab03d6 tempest-SnapshotsActionsTest-1540369714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:43 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-82cecf81-9816-4641-bee0-f4654057ab76 req-26bba344-5ec7-42e4-a943-fa09d77cd69d tempest-AttachVolumeNegativeTest-621359088 None] attachment_update completed successfully. Nov 03 13:12:43 devstack sudo[94711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 Nov 03 13:12:43 devstack sudo[94711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:44 devstack sudo[94711]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3d37aa02-f511-49e9-b6e4-28e4f8ab03d6 tempest-SnapshotsActionsTest-1540369714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316" returned: 0 in 0.519s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-3d37aa02-f511-49e9-b6e4-28e4f8ab03d6 tempest-SnapshotsActionsTest-1540369714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df335671-3489-48ff-bbaa-661bdd13b332(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:12:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3d37aa02-f511-49e9-b6e4-28e4f8ab03d6 tempest-SnapshotsActionsTest-1540369714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.36d10315-b243-44c9-be33-0f98bf83eea4 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:44 devstack sudo[95134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.36d10315-b243-44c9-be33-0f98bf83eea4 Nov 03 13:12:44 devstack sudo[95134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:44 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9bf2e7ec-0cab-4f42-8998-55f610b47bf5 tempest-VolumesGetTest-2074296944 None] Acquiring lock "cinder-4ddbfc38-b4eb-435d-843d-2a918dc2fb14-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:44 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9bf2e7ec-0cab-4f42-8998-55f610b47bf5 tempest-VolumesGetTest-2074296944 None] Lock "cinder-4ddbfc38-b4eb-435d-843d-2a918dc2fb14-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:44 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9bf2e7ec-0cab-4f42-8998-55f610b47bf5 tempest-VolumesGetTest-2074296944 None] Acquiring lock "cinder-quobyte-4ddbfc38-b4eb-435d-843d-2a918dc2fb14" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:44 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9bf2e7ec-0cab-4f42-8998-55f610b47bf5 tempest-VolumesGetTest-2074296944 None] Lock "cinder-quobyte-4ddbfc38-b4eb-435d-843d-2a918dc2fb14" acquired by "delete_volume" :: waited 0.025s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:44 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee30e148-08da-432c-80da-617a5d8c025b]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9bf2e7ec-0cab-4f42-8998-55f610b47bf5 tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4ddbfc38-b4eb-435d-843d-2a918dc2fb14 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:44 devstack sudo[95141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4ddbfc38-b4eb-435d-843d-2a918dc2fb14 Nov 03 13:12:44 devstack sudo[95134]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:44 devstack sudo[95141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3d37aa02-f511-49e9-b6e4-28e4f8ab03d6 tempest-SnapshotsActionsTest-1540369714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.36d10315-b243-44c9-be33-0f98bf83eea4" returned: 0 in 0.608s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3d37aa02-f511-49e9-b6e4-28e4f8ab03d6 tempest-SnapshotsActionsTest-1540369714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.36d10315-b243-44c9-be33-0f98bf83eea4 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:44 devstack sudo[95143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.36d10315-b243-44c9-be33-0f98bf83eea4 Nov 03 13:12:44 devstack sudo[95143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:45 devstack sudo[95143]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3d37aa02-f511-49e9-b6e4-28e4f8ab03d6 tempest-SnapshotsActionsTest-1540369714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.36d10315-b243-44c9-be33-0f98bf83eea4" returned: 0 in 0.313s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:45 devstack sudo[95141]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9bf2e7ec-0cab-4f42-8998-55f610b47bf5 tempest-VolumesGetTest-2074296944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4ddbfc38-b4eb-435d-843d-2a918dc2fb14" returned: 0 in 0.478s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9bf2e7ec-0cab-4f42-8998-55f610b47bf5 tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4ddbfc38-b4eb-435d-843d-2a918dc2fb14 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:45 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3d37aa02-f511-49e9-b6e4-28e4f8ab03d6 tempest-SnapshotsActionsTest-1540369714 None] Lock "cinder-quobyte-36d10315-b243-44c9-be33-0f98bf83eea4" released by "_delete_snapshot" :: held 2.083s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:45 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3d37aa02-f511-49e9-b6e4-28e4f8ab03d6 tempest-SnapshotsActionsTest-1540369714 None] Lock "cinder-quobyte-df335671-3489-48ff-bbaa-661bdd13b332" released by "delete_snapshot" :: held 2.116s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:45 devstack sudo[95149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4ddbfc38-b4eb-435d-843d-2a918dc2fb14 Nov 03 13:12:45 devstack sudo[95149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:45 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-3d37aa02-f511-49e9-b6e4-28e4f8ab03d6 tempest-SnapshotsActionsTest-1540369714 None] Created reservations ['dafff579-174a-4211-a8a0-f5dcad3aa261', '216c557a-090b-4d00-9fa6-1cb374c91eda', '67e8b49a-abda-4ecc-8d28-fdef5b97e464', 'bf1645df-d76b-4033-ad82-d650d48807b8'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:12:45 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-3d37aa02-f511-49e9-b6e4-28e4f8ab03d6 tempest-SnapshotsActionsTest-1540369714 None] Delete snapshot completed successfully. Nov 03 13:12:45 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3d37aa02-f511-49e9-b6e4-28e4f8ab03d6 tempest-SnapshotsActionsTest-1540369714 None] Lock "cinder-36d10315-b243-44c9-be33-0f98bf83eea4-delete_snapshot" released by "delete_snapshot" :: held 2.305s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:45 devstack sudo[95149]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9bf2e7ec-0cab-4f42-8998-55f610b47bf5 tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4ddbfc38-b4eb-435d-843d-2a918dc2fb14" returned: 0 in 0.373s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:45 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9bf2e7ec-0cab-4f42-8998-55f610b47bf5 tempest-VolumesGetTest-2074296944 None] Lock "cinder-quobyte-4ddbfc38-b4eb-435d-843d-2a918dc2fb14" released by "delete_volume" :: held 0.913s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:45 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-9bf2e7ec-0cab-4f42-8998-55f610b47bf5 tempest-VolumesGetTest-2074296944 None] Created reservations ['7edb0b11-382d-4988-acff-f70f066419ad', '4eba2b5b-a1bf-4f7f-94d4-ac6ebb581a33', '472d7f2d-962b-4498-b4b5-d7f7686d999b', '8b264dd9-79e4-4e70-a5bd-de4d3724d4f1'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:12:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9bf2e7ec-0cab-4f42-8998-55f610b47bf5 tempest-VolumesGetTest-2074296944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9bf2e7ec-0cab-4f42-8998-55f610b47bf5 tempest-VolumesGetTest-2074296944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:45 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-9bf2e7ec-0cab-4f42-8998-55f610b47bf5 tempest-VolumesGetTest-2074296944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:45 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-9bf2e7ec-0cab-4f42-8998-55f610b47bf5 tempest-VolumesGetTest-2074296944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9bf2e7ec-0cab-4f42-8998-55f610b47bf5 tempest-VolumesGetTest-2074296944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9bf2e7ec-0cab-4f42-8998-55f610b47bf5 tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-d8098b76-873e-42e5-98c2-e201da2d20db req-b4dfa69f-8aa1-460b-b77b-e13aa7820d29 tempest-ServerActionsTestOtherA-2024956670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-d8098b76-873e-42e5-98c2-e201da2d20db req-b4dfa69f-8aa1-460b-b77b-e13aa7820d29 tempest-ServerActionsTestOtherA-2024956670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:45 devstack sudo[95162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:12:45 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-d8098b76-873e-42e5-98c2-e201da2d20db req-b4dfa69f-8aa1-460b-b77b-e13aa7820d29 tempest-ServerActionsTestOtherA-2024956670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-d8098b76-873e-42e5-98c2-e201da2d20db req-b4dfa69f-8aa1-460b-b77b-e13aa7820d29 tempest-ServerActionsTestOtherA-2024956670 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43', 'name': 'volume-4ef6494c-6050-43f3-a045-8482e64733b0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b6305cad-18d5-464d-a191-d8ede80a9220', 'enforce_multipath': True} {{(pid=86725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:12:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a6daa9c7-0f0f-4069-9eb5-70c032c16184 tempest-VolumesGetTest-2074296944 None] Acquiring lock "cinder-4314f99b-fca6-47a7-abd5-50cc0ff7388e-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:46 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-d8098b76-873e-42e5-98c2-e201da2d20db req-b4dfa69f-8aa1-460b-b77b-e13aa7820d29 tempest-ServerActionsTestOtherA-2024956670 None] attachment_update completed successfully. Nov 03 13:12:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a6daa9c7-0f0f-4069-9eb5-70c032c16184 tempest-VolumesGetTest-2074296944 None] Lock "cinder-4314f99b-fca6-47a7-abd5-50cc0ff7388e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a6daa9c7-0f0f-4069-9eb5-70c032c16184 tempest-VolumesGetTest-2074296944 None] Acquiring lock "cinder-quobyte-4314f99b-fca6-47a7-abd5-50cc0ff7388e" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a6daa9c7-0f0f-4069-9eb5-70c032c16184 tempest-VolumesGetTest-2074296944 None] Lock "cinder-quobyte-4314f99b-fca6-47a7-abd5-50cc0ff7388e" acquired by "delete_volume" :: waited 0.033s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:46 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fce1c33-c559-4e69-9dcc-959d89d22677]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a6daa9c7-0f0f-4069-9eb5-70c032c16184 tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4314f99b-fca6-47a7-abd5-50cc0ff7388e {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:46 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9bf2e7ec-0cab-4f42-8998-55f610b47bf5 tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.387s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:46 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-9bf2e7ec-0cab-4f42-8998-55f610b47bf5 tempest-VolumesGetTest-2074296944 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:12:46 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-9bf2e7ec-0cab-4f42-8998-55f610b47bf5 tempest-VolumesGetTest-2074296944 None] Deleted volume successfully. Nov 03 13:12:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9bf2e7ec-0cab-4f42-8998-55f610b47bf5 tempest-VolumesGetTest-2074296944 None] Lock "cinder-4ddbfc38-b4eb-435d-843d-2a918dc2fb14-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:46 devstack sudo[95165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4314f99b-fca6-47a7-abd5-50cc0ff7388e Nov 03 13:12:46 devstack sudo[95165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:46 devstack sudo[95165]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a6daa9c7-0f0f-4069-9eb5-70c032c16184 tempest-VolumesGetTest-2074296944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4314f99b-fca6-47a7-abd5-50cc0ff7388e" returned: 0 in 0.601s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a6daa9c7-0f0f-4069-9eb5-70c032c16184 tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4314f99b-fca6-47a7-abd5-50cc0ff7388e {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:46 devstack sudo[95173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4314f99b-fca6-47a7-abd5-50cc0ff7388e Nov 03 13:12:46 devstack sudo[95173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:46 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-16934f20-5963-41be-b7de-655bc8177bd6 req-bd7cce6b-1f24-46ed-9178-f40e40c0cd6e tempest-AttachVolumeNegativeTest-621359088 None] Terminate volume connection completed successfully. Nov 03 13:12:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-16934f20-5963-41be-b7de-655bc8177bd6 req-bd7cce6b-1f24-46ed-9178-f40e40c0cd6e tempest-AttachVolumeNegativeTest-621359088 None] Deleting attachment a394840c-512c-48e2-90f5-79be9e012925. {{(pid=86725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:12:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b64f32b5-4e1f-44cf-838f-6de6f8675a53 tempest-SnapshotsActionsTest-1901950821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b64f32b5-4e1f-44cf-838f-6de6f8675a53 tempest-SnapshotsActionsTest-1901950821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:47 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-b64f32b5-4e1f-44cf-838f-6de6f8675a53 tempest-SnapshotsActionsTest-1901950821 None] Creating offline snapshot 3ee22316-70a8-4d7d-972c-8ced1b23c30b of volume df335671-3489-48ff-bbaa-661bdd13b332 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:12:47 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced6f9c0-49db-4e7a-a4a9-28f283755674]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b64f32b5-4e1f-44cf-838f-6de6f8675a53 tempest-SnapshotsActionsTest-1901950821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:47 devstack sudo[95173]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a6daa9c7-0f0f-4069-9eb5-70c032c16184 tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4314f99b-fca6-47a7-abd5-50cc0ff7388e" returned: 0 in 0.365s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:47 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a6daa9c7-0f0f-4069-9eb5-70c032c16184 tempest-VolumesGetTest-2074296944 None] Lock "cinder-quobyte-4314f99b-fca6-47a7-abd5-50cc0ff7388e" released by "delete_volume" :: held 1.057s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:47 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-a6daa9c7-0f0f-4069-9eb5-70c032c16184 tempest-VolumesGetTest-2074296944 None] Created reservations ['07d0c0a8-1da8-4ae6-85bb-062b0e1171fa', '2342e02b-4779-4101-b815-bad04dc252fb', 'ca994cf0-aa14-4b92-b068-0f970822b80a', 'db3f7534-6710-43de-9dc6-d7937bb9e0d0'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:12:47 devstack sudo[95200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 Nov 03 13:12:47 devstack sudo[95200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a6daa9c7-0f0f-4069-9eb5-70c032c16184 tempest-VolumesGetTest-2074296944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a6daa9c7-0f0f-4069-9eb5-70c032c16184 tempest-VolumesGetTest-2074296944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:47 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a6daa9c7-0f0f-4069-9eb5-70c032c16184 tempest-VolumesGetTest-2074296944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:47 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a6daa9c7-0f0f-4069-9eb5-70c032c16184 tempest-VolumesGetTest-2074296944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a6daa9c7-0f0f-4069-9eb5-70c032c16184 tempest-VolumesGetTest-2074296944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a6daa9c7-0f0f-4069-9eb5-70c032c16184 tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:47 devstack sudo[95202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:12:47 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:47 devstack sudo[95200]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b64f32b5-4e1f-44cf-838f-6de6f8675a53 tempest-SnapshotsActionsTest-1901950821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316" returned: 0 in 0.479s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:47 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-b64f32b5-4e1f-44cf-838f-6de6f8675a53 tempest-SnapshotsActionsTest-1901950821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df335671-3489-48ff-bbaa-661bdd13b332(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:12:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b64f32b5-4e1f-44cf-838f-6de6f8675a53 tempest-SnapshotsActionsTest-1901950821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.3ee22316-70a8-4d7d-972c-8ced1b23c30b 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:47 devstack sudo[95208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.3ee22316-70a8-4d7d-972c-8ced1b23c30b 1G Nov 03 13:12:47 devstack sudo[95208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:47 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a6daa9c7-0f0f-4069-9eb5-70c032c16184 tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.304s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:47 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-a6daa9c7-0f0f-4069-9eb5-70c032c16184 tempest-VolumesGetTest-2074296944 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:12:47 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-a6daa9c7-0f0f-4069-9eb5-70c032c16184 tempest-VolumesGetTest-2074296944 None] Deleted volume successfully. Nov 03 13:12:47 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a6daa9c7-0f0f-4069-9eb5-70c032c16184 tempest-VolumesGetTest-2074296944 None] Lock "cinder-4314f99b-fca6-47a7-abd5-50cc0ff7388e-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:48 devstack sudo[95208]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b64f32b5-4e1f-44cf-838f-6de6f8675a53 tempest-SnapshotsActionsTest-1901950821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.3ee22316-70a8-4d7d-972c-8ced1b23c30b 1G" returned: 0 in 0.833s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b64f32b5-4e1f-44cf-838f-6de6f8675a53 tempest-SnapshotsActionsTest-1901950821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.3ee22316-70a8-4d7d-972c-8ced1b23c30b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:48 devstack sudo[95238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.3ee22316-70a8-4d7d-972c-8ced1b23c30b Nov 03 13:12:48 devstack sudo[95238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:48 devstack sudo[95238]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b64f32b5-4e1f-44cf-838f-6de6f8675a53 tempest-SnapshotsActionsTest-1901950821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.3ee22316-70a8-4d7d-972c-8ced1b23c30b" returned: 0 in 0.443s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:48 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-b64f32b5-4e1f-44cf-838f-6de6f8675a53 tempest-SnapshotsActionsTest-1901950821 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.3ee22316-70a8-4d7d-972c-8ced1b23c30b is being set with open permissions: ugo+rw Nov 03 13:12:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b64f32b5-4e1f-44cf-838f-6de6f8675a53 tempest-SnapshotsActionsTest-1901950821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.3ee22316-70a8-4d7d-972c-8ced1b23c30b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:48 devstack sudo[95246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.3ee22316-70a8-4d7d-972c-8ced1b23c30b Nov 03 13:12:48 devstack sudo[95246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:49 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:12:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] Flow 'volume_create_manager' (7d1e7291-e619-45a3-8219-87262cb15a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e030e036-2d6d-4f62-b165-c4e2517e1a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:49 devstack sudo[95246]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e030e036-2d6d-4f62-b165-c4e2517e1a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-665180599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=835adc47-bb06-4be8-a197-aceb34d31b1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9522a11a75cf44bc84765823c173de83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:49Z,use_quota=True,user_id='fd4dfb10072d401385a629c2ba422dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1634df23-832f-4146-bd87-2d6c31fa7eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1634df23-832f-4146-bd87-2d6c31fa7eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (579501be-ba42-4b2d-b720-f84ea3bbdc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (579501be-ba42-4b2d-b720-f84ea3bbdc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '835adc47-bb06-4be8-a197-aceb34d31b1e', 'volume_name': 'volume-835adc47-bb06-4be8-a197-aceb34d31b1e', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (defca708-84c6-4f5b-85e6-66868afdb71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (defca708-84c6-4f5b-85e6-66868afdb71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f64097f-e023-431a-b82f-8b4373f963c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:49 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] Volume 835adc47-bb06-4be8-a197-aceb34d31b1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-835adc47-bb06-4be8-a197-aceb34d31b1e', 'volume_size': 1} Nov 03 13:12:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b64f32b5-4e1f-44cf-838f-6de6f8675a53 tempest-SnapshotsActionsTest-1901950821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.3ee22316-70a8-4d7d-972c-8ced1b23c30b" returned: 0 in 0.430s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b64f32b5-4e1f-44cf-838f-6de6f8675a53 tempest-SnapshotsActionsTest-1901950821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.349s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.072s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-665180599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=835adc47-bb06-4be8-a197-aceb34d31b1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9522a11a75cf44bc84765823c173de83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:49Z,use_quota=True,user_id='fd4dfb10072d401385a629c2ba422dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:12:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] Creating volume 835adc47-bb06-4be8-a197-aceb34d31b1e {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:12:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:12:49 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:12:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:49 devstack sudo[95250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e 1073741824 Nov 03 13:12:49 devstack sudo[95250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:49 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-b64f32b5-4e1f-44cf-838f-6de6f8675a53 tempest-SnapshotsActionsTest-1901950821 None] Create snapshot completed successfully Nov 03 13:12:49 devstack sudo[95250]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e 1073741824" returned: 0 in 0.523s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:50 devstack sudo[95257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e Nov 03 13:12:50 devstack sudo[95257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:50 devstack sudo[95257]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e" returned: 0 in 0.411s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:12:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f64097f-e023-431a-b82f-8b4373f963c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-835adc47-bb06-4be8-a197-aceb34d31b1e', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c390dfa-6b21-4112-be44-389a12df787b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4a64be17-df0d-48c8-b34f-00f3fa07d594 tempest-SnapshotsActionsTest-1540369714 None] Acquiring lock "cinder-3ee22316-70a8-4d7d-972c-8ced1b23c30b-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:50 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] Volume volume-835adc47-bb06-4be8-a197-aceb34d31b1e (835adc47-bb06-4be8-a197-aceb34d31b1e): created successfully Nov 03 13:12:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c390dfa-6b21-4112-be44-389a12df787b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] Flow 'volume_create_manager' (7d1e7291-e619-45a3-8219-87262cb15a16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4a64be17-df0d-48c8-b34f-00f3fa07d594 tempest-SnapshotsActionsTest-1540369714 None] Lock "cinder-3ee22316-70a8-4d7d-972c-8ced1b23c30b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.100s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4a64be17-df0d-48c8-b34f-00f3fa07d594 tempest-SnapshotsActionsTest-1540369714 None] Acquiring lock "cinder-quobyte-df335671-3489-48ff-bbaa-661bdd13b332" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4a64be17-df0d-48c8-b34f-00f3fa07d594 tempest-SnapshotsActionsTest-1540369714 None] Lock "cinder-quobyte-df335671-3489-48ff-bbaa-661bdd13b332" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4a64be17-df0d-48c8-b34f-00f3fa07d594 tempest-SnapshotsActionsTest-1540369714 None] Acquiring lock "cinder-quobyte-3ee22316-70a8-4d7d-972c-8ced1b23c30b" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:50 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-7ee19040-ffb3-4e19-9499-3bff7fc51268 tempest-VolumesGetTest-2074296944 None] Created volume successfully. Nov 03 13:12:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4a64be17-df0d-48c8-b34f-00f3fa07d594 tempest-SnapshotsActionsTest-1540369714 None] Lock "cinder-quobyte-3ee22316-70a8-4d7d-972c-8ced1b23c30b" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-4a64be17-df0d-48c8-b34f-00f3fa07d594 tempest-SnapshotsActionsTest-1540369714 None] Deleting offline snapshot 3ee22316-70a8-4d7d-972c-8ced1b23c30b of volume df335671-3489-48ff-bbaa-661bdd13b332 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:12:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-4a64be17-df0d-48c8-b34f-00f3fa07d594 tempest-SnapshotsActionsTest-1540369714 None] snapshot_file for this snap is: volume-df335671-3489-48ff-bbaa-661bdd13b332.3ee22316-70a8-4d7d-972c-8ced1b23c30b {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:12:50 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[081b05a6-c36f-40bc-bb8b-27a712a1d985]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4a64be17-df0d-48c8-b34f-00f3fa07d594 tempest-SnapshotsActionsTest-1540369714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.3ee22316-70a8-4d7d-972c-8ced1b23c30b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:50 devstack sudo[95372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.3ee22316-70a8-4d7d-972c-8ced1b23c30b Nov 03 13:12:50 devstack sudo[95372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:51 devstack sudo[95372]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4a64be17-df0d-48c8-b34f-00f3fa07d594 tempest-SnapshotsActionsTest-1540369714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.3ee22316-70a8-4d7d-972c-8ced1b23c30b" returned: 0 in 0.633s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-4a64be17-df0d-48c8-b34f-00f3fa07d594 tempest-SnapshotsActionsTest-1540369714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df335671-3489-48ff-bbaa-661bdd13b332(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:12:51 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ce8ec0-0241-452c-9864-66143f9aacde]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4a64be17-df0d-48c8-b34f-00f3fa07d594 tempest-SnapshotsActionsTest-1540369714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:51 devstack sudo[95716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 Nov 03 13:12:51 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:52 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4a64be17-df0d-48c8-b34f-00f3fa07d594 tempest-SnapshotsActionsTest-1540369714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316" returned: 0 in 0.683s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:52 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-4a64be17-df0d-48c8-b34f-00f3fa07d594 tempest-SnapshotsActionsTest-1540369714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df335671-3489-48ff-bbaa-661bdd13b332(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:12:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4a64be17-df0d-48c8-b34f-00f3fa07d594 tempest-SnapshotsActionsTest-1540369714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.3ee22316-70a8-4d7d-972c-8ced1b23c30b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:52 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:12:52 devstack sudo[95721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.3ee22316-70a8-4d7d-972c-8ced1b23c30b Nov 03 13:12:52 devstack sudo[95721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Flow 'volume_create_manager' (c6994dda-8759-4307-b082-de45445600c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f8e2b6-0e04-4cd1-8999-15d5301f1c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f8e2b6-0e04-4cd1-8999-15d5301f1c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1962565331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ab6e545-3549-45bc-b4cd-df284569842d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9522a11a75cf44bc84765823c173de83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=835adc47-bb06-4be8-a197-aceb34d31b1e,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:52Z,use_quota=True,user_id='fd4dfb10072d401385a629c2ba422dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a099f671-8b2a-4cfa-9f37-28fcbc2c689e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a099f671-8b2a-4cfa-9f37-28fcbc2c689e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3564c0-c175-4194-ba50-29c50f0391cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3564c0-c175-4194-ba50-29c50f0391cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3ab6e545-3549-45bc-b4cd-df284569842d', 'volume_name': 'volume-3ab6e545-3549-45bc-b4cd-df284569842d', 'volume_size': 1, 'source_volid': '835adc47-bb06-4be8-a197-aceb34d31b1e', 'source_volstatus': 'available'}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc3e3bf-5d1d-4e21-9761-3843fb18edae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc3e3bf-5d1d-4e21-9761-3843fb18edae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a122d3-cc17-494c-8e21-6b0bc8e1acc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:52 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Volume 3ab6e545-3549-45bc-b4cd-df284569842d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3ab6e545-3549-45bc-b4cd-df284569842d', 'volume_size': 1, 'source_volid': '835adc47-bb06-4be8-a197-aceb34d31b1e', 'source_volstatus': 'available'} Nov 03 13:12:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:52 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Cloning volume 835adc47-bb06-4be8-a197-aceb34d31b1e to volume 3ab6e545-3549-45bc-b4cd-df284569842d Nov 03 13:12:52 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Creating offline snapshot 238d5d76-b5c4-4911-af58-960ee7c75fc1 of volume 835adc47-bb06-4be8-a197-aceb34d31b1e {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:12:52 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe121149-17e9-4f11-9d53-5345a23be60d]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:52 devstack sudo[95725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e Nov 03 13:12:52 devstack sudo[95725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:52 devstack sudo[95721]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4a64be17-df0d-48c8-b34f-00f3fa07d594 tempest-SnapshotsActionsTest-1540369714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.3ee22316-70a8-4d7d-972c-8ced1b23c30b" returned: 0 in 0.781s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4a64be17-df0d-48c8-b34f-00f3fa07d594 tempest-SnapshotsActionsTest-1540369714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.3ee22316-70a8-4d7d-972c-8ced1b23c30b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:53 devstack sudo[95732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.3ee22316-70a8-4d7d-972c-8ced1b23c30b Nov 03 13:12:53 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:53 devstack sudo[95725]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e" returned: 0 in 0.814s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e.238d5d76-b5c4-4911-af58-960ee7c75fc1 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:53 devstack sudo[95738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e.238d5d76-b5c4-4911-af58-960ee7c75fc1 1G Nov 03 13:12:53 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:53 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4a64be17-df0d-48c8-b34f-00f3fa07d594 tempest-SnapshotsActionsTest-1540369714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.3ee22316-70a8-4d7d-972c-8ced1b23c30b" returned: 0 in 0.448s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4a64be17-df0d-48c8-b34f-00f3fa07d594 tempest-SnapshotsActionsTest-1540369714 None] Lock "cinder-quobyte-3ee22316-70a8-4d7d-972c-8ced1b23c30b" released by "_delete_snapshot" :: held 2.749s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4a64be17-df0d-48c8-b34f-00f3fa07d594 tempest-SnapshotsActionsTest-1540369714 None] Lock "cinder-quobyte-df335671-3489-48ff-bbaa-661bdd13b332" released by "delete_snapshot" :: held 2.803s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:53 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-4a64be17-df0d-48c8-b34f-00f3fa07d594 tempest-SnapshotsActionsTest-1540369714 None] Created reservations ['4c639b6d-6fa4-4494-a036-7782f167b27e', '8c74e4e6-5f3e-40ec-98e9-6556bab88cf0', '62f52786-6902-4283-a18e-1465ee51c58c', '03528a73-a709-42b2-b040-70f74bd408cc'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:12:53 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-4a64be17-df0d-48c8-b34f-00f3fa07d594 tempest-SnapshotsActionsTest-1540369714 None] Delete snapshot completed successfully. Nov 03 13:12:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4a64be17-df0d-48c8-b34f-00f3fa07d594 tempest-SnapshotsActionsTest-1540369714 None] Lock "cinder-3ee22316-70a8-4d7d-972c-8ced1b23c30b-delete_snapshot" released by "delete_snapshot" :: held 3.028s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:53 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e.238d5d76-b5c4-4911-af58-960ee7c75fc1 1G" returned: 0 in 0.506s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-835adc47-bb06-4be8-a197-aceb34d31b1e -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e.238d5d76-b5c4-4911-af58-960ee7c75fc1 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:53 devstack sudo[95744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-835adc47-bb06-4be8-a197-aceb34d31b1e -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e.238d5d76-b5c4-4911-af58-960ee7c75fc1 Nov 03 13:12:53 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:54 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-835adc47-bb06-4be8-a197-aceb34d31b1e -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e.238d5d76-b5c4-4911-af58-960ee7c75fc1" returned: 0 in 0.459s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:54 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e.238d5d76-b5c4-4911-af58-960ee7c75fc1 is being set with open permissions: ugo+rw Nov 03 13:12:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e.238d5d76-b5c4-4911-af58-960ee7c75fc1 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:54 devstack sudo[95749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e.238d5d76-b5c4-4911-af58-960ee7c75fc1 Nov 03 13:12:54 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d684ab1f-b856-430d-bfcb-3eeb60ceafe0 tempest-SnapshotsActionsTest-1901950821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:54 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e.238d5d76-b5c4-4911-af58-960ee7c75fc1" returned: 0 in 0.457s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:54 devstack sudo[95752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e.info Nov 03 13:12:54 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:55 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e.info" returned: 0 in 0.307s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:55 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e.info is being set with open permissions: ugo+rw Nov 03 13:12:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:55 devstack sudo[95761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e.info Nov 03 13:12:55 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:55 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e.info" returned: 0 in 0.489s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:55 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Acquiring lock "cinder-quobyte-3ab6e545-3549-45bc-b4cd-df284569842d" by "_copy_volume_from_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:55 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Lock "cinder-quobyte-3ab6e545-3549-45bc-b4cd-df284569842d" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:55 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] snapshot: 238d5d76-b5c4-4911-af58-960ee7c75fc1, volume: 3ab6e545-3549-45bc-b4cd-df284569842d, {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 13:12:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:55 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:55 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:55 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b0d37488-e818-4969-944c-e73646999aa7 tempest-AttachVolumeNegativeTest-621359088 None] Acquiring lock "cinder-9417f773-0a02-4288-8e3c-f585c15b8d82-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:55 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[444737c4-3cbe-412d-bfee-58895a34f361]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e.238d5d76-b5c4-4911-af58-960ee7c75fc1 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:55 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b0d37488-e818-4969-944c-e73646999aa7 tempest-AttachVolumeNegativeTest-621359088 None] Lock "cinder-9417f773-0a02-4288-8e3c-f585c15b8d82-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:55 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b0d37488-e818-4969-944c-e73646999aa7 tempest-AttachVolumeNegativeTest-621359088 None] Acquiring lock "cinder-quobyte-9417f773-0a02-4288-8e3c-f585c15b8d82" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:55 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b0d37488-e818-4969-944c-e73646999aa7 tempest-AttachVolumeNegativeTest-621359088 None] Lock "cinder-quobyte-9417f773-0a02-4288-8e3c-f585c15b8d82" acquired by "delete_volume" :: waited 0.026s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:55 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cd25a2-e4ce-4922-8655-3f09ba242eae]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b0d37488-e818-4969-944c-e73646999aa7 tempest-AttachVolumeNegativeTest-621359088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9417f773-0a02-4288-8e3c-f585c15b8d82 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:55 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e.238d5d76-b5c4-4911-af58-960ee7c75fc1 Nov 03 13:12:55 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:56 devstack sudo[95767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9417f773-0a02-4288-8e3c-f585c15b8d82 Nov 03 13:12:56 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:56 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e.238d5d76-b5c4-4911-af58-960ee7c75fc1" returned: 0 in 0.624s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:56 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-835adc47-bb06-4be8-a197-aceb34d31b1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:12:56 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbd6983-8f6c-4ae7-a1c2-31c829802c37]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:56 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b0d37488-e818-4969-944c-e73646999aa7 tempest-AttachVolumeNegativeTest-621359088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9417f773-0a02-4288-8e3c-f585c15b8d82" returned: 0 in 0.636s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b0d37488-e818-4969-944c-e73646999aa7 tempest-AttachVolumeNegativeTest-621359088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9417f773-0a02-4288-8e3c-f585c15b8d82 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:56 devstack sudo[95773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e Nov 03 13:12:56 devstack sudo[95773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:56 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9417f773-0a02-4288-8e3c-f585c15b8d82 Nov 03 13:12:56 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:57 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b0d37488-e818-4969-944c-e73646999aa7 tempest-AttachVolumeNegativeTest-621359088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9417f773-0a02-4288-8e3c-f585c15b8d82" returned: 0 in 0.439s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:57 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b0d37488-e818-4969-944c-e73646999aa7 tempest-AttachVolumeNegativeTest-621359088 None] Lock "cinder-quobyte-9417f773-0a02-4288-8e3c-f585c15b8d82" released by "delete_volume" :: held 1.135s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:57 devstack sudo[95773]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e" returned: 0 in 0.671s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:57 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 13:12:57 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Creating direct copy from snapshot {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 13:12:57 devstack cinder-volume[86725]: DEBUG cinder.utils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Path /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3ab6e545-3549-45bc-b4cd-df284569842d not found in is_blk_device check {{(pid=86725) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 13:12:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3ab6e545-3549-45bc-b4cd-df284569842d {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:57 devstack sudo[95785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3ab6e545-3549-45bc-b4cd-df284569842d Nov 03 13:12:57 devstack sudo[95785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:57 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-b0d37488-e818-4969-944c-e73646999aa7 tempest-AttachVolumeNegativeTest-621359088 None] Created reservations ['3a7cbc91-9a6d-4277-9a41-b2b7a98f57d8', '1496dfb9-e07a-41f7-8885-2338303ce0b6', 'f13215e1-8c28-42a1-a3f4-87098f6b2479', '3602e540-d781-4583-8dbf-486a01983f39'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:12:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b0d37488-e818-4969-944c-e73646999aa7 tempest-AttachVolumeNegativeTest-621359088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b0d37488-e818-4969-944c-e73646999aa7 tempest-AttachVolumeNegativeTest-621359088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:57 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b0d37488-e818-4969-944c-e73646999aa7 tempest-AttachVolumeNegativeTest-621359088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:57 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b0d37488-e818-4969-944c-e73646999aa7 tempest-AttachVolumeNegativeTest-621359088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b0d37488-e818-4969-944c-e73646999aa7 tempest-AttachVolumeNegativeTest-621359088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b0d37488-e818-4969-944c-e73646999aa7 tempest-AttachVolumeNegativeTest-621359088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:57 devstack sudo[95788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:12:57 devstack sudo[95788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:57 devstack sudo[95788]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b0d37488-e818-4969-944c-e73646999aa7 tempest-AttachVolumeNegativeTest-621359088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.315s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:57 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-b0d37488-e818-4969-944c-e73646999aa7 tempest-AttachVolumeNegativeTest-621359088 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:12:57 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-b0d37488-e818-4969-944c-e73646999aa7 tempest-AttachVolumeNegativeTest-621359088 None] Deleted volume successfully. Nov 03 13:12:57 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b0d37488-e818-4969-944c-e73646999aa7 tempest-AttachVolumeNegativeTest-621359088 None] Lock "cinder-9417f773-0a02-4288-8e3c-f585c15b8d82-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:58 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b5e0a3c6-8c1f-4db1-9063-eb509fb21c26 tempest-AttachVolumeNegativeTest-621359088 None] Acquiring lock "cinder-95977941-3421-4be3-988b-674bf84702b0-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:58 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b5e0a3c6-8c1f-4db1-9063-eb509fb21c26 tempest-AttachVolumeNegativeTest-621359088 None] Lock "cinder-95977941-3421-4be3-988b-674bf84702b0-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:58 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b5e0a3c6-8c1f-4db1-9063-eb509fb21c26 tempest-AttachVolumeNegativeTest-621359088 None] Acquiring lock "cinder-quobyte-95977941-3421-4be3-988b-674bf84702b0" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:58 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:12:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:58 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b5e0a3c6-8c1f-4db1-9063-eb509fb21c26 tempest-AttachVolumeNegativeTest-621359088 None] Lock "cinder-quobyte-95977941-3421-4be3-988b-674bf84702b0" acquired by "delete_volume" :: waited 0.096s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:58 devstack sudo[95802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:12:58 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:58 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[3747aaeb-2e2e-4856-bb00-b70c36cdb98a]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b5e0a3c6-8c1f-4db1-9063-eb509fb21c26 tempest-AttachVolumeNegativeTest-621359088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-95977941-3421-4be3-988b-674bf84702b0 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:59 devstack sudo[95804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-95977941-3421-4be3-988b-674bf84702b0 Nov 03 13:12:59 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:59 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.834s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:59 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:12:59 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager._thread_info {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:12:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread count: 28 {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:12:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread info: [<_MainThread(MainThread, started 133507074375808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:13:00 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b5e0a3c6-8c1f-4db1-9063-eb509fb21c26 tempest-AttachVolumeNegativeTest-621359088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-95977941-3421-4be3-988b-674bf84702b0" returned: 0 in 1.459s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b5e0a3c6-8c1f-4db1-9063-eb509fb21c26 tempest-AttachVolumeNegativeTest-621359088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-95977941-3421-4be3-988b-674bf84702b0 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:00 devstack sudo[95811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-95977941-3421-4be3-988b-674bf84702b0 Nov 03 13:13:00 devstack sudo[95811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:00 devstack sudo[95811]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b5e0a3c6-8c1f-4db1-9063-eb509fb21c26 tempest-AttachVolumeNegativeTest-621359088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-95977941-3421-4be3-988b-674bf84702b0" returned: 0 in 0.575s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b5e0a3c6-8c1f-4db1-9063-eb509fb21c26 tempest-AttachVolumeNegativeTest-621359088 None] Lock "cinder-quobyte-95977941-3421-4be3-988b-674bf84702b0" released by "delete_volume" :: held 2.176s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:01 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-b5e0a3c6-8c1f-4db1-9063-eb509fb21c26 tempest-AttachVolumeNegativeTest-621359088 None] Created reservations ['0808ef0c-f447-416d-994e-a9133ff3fa5d', 'dacaa3ec-afc6-4c08-89f0-7df853bd1dba', '03e95e16-f237-449d-be65-39b021e6f385', '057e92ea-75bb-470b-a987-59dcc369a0de'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b5e0a3c6-8c1f-4db1-9063-eb509fb21c26 tempest-AttachVolumeNegativeTest-621359088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b5e0a3c6-8c1f-4db1-9063-eb509fb21c26 tempest-AttachVolumeNegativeTest-621359088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:01 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b5e0a3c6-8c1f-4db1-9063-eb509fb21c26 tempest-AttachVolumeNegativeTest-621359088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:01 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b5e0a3c6-8c1f-4db1-9063-eb509fb21c26 tempest-AttachVolumeNegativeTest-621359088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b5e0a3c6-8c1f-4db1-9063-eb509fb21c26 tempest-AttachVolumeNegativeTest-621359088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b5e0a3c6-8c1f-4db1-9063-eb509fb21c26 tempest-AttachVolumeNegativeTest-621359088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:01 devstack sudo[95814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:13:01 devstack sudo[95814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:01 devstack sudo[95814]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b5e0a3c6-8c1f-4db1-9063-eb509fb21c26 tempest-AttachVolumeNegativeTest-621359088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.488s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:01 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-b5e0a3c6-8c1f-4db1-9063-eb509fb21c26 tempest-AttachVolumeNegativeTest-621359088 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:01 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-b5e0a3c6-8c1f-4db1-9063-eb509fb21c26 tempest-AttachVolumeNegativeTest-621359088 None] Deleted volume successfully. Nov 03 13:13:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b5e0a3c6-8c1f-4db1-9063-eb509fb21c26 tempest-AttachVolumeNegativeTest-621359088 None] Lock "cinder-95977941-3421-4be3-988b-674bf84702b0-delete_volume" released by "delete_volume" :: held 3.375s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3e942c89-de68-45c0-818b-2e53b50649f9 tempest-AttachVolumeNegativeTest-621359088 None] Acquiring lock "cinder-c4e43372-bcb2-48e1-8bbd-ed20f965f6d3-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3e942c89-de68-45c0-818b-2e53b50649f9 tempest-AttachVolumeNegativeTest-621359088 None] Lock "cinder-c4e43372-bcb2-48e1-8bbd-ed20f965f6d3-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:03 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3e942c89-de68-45c0-818b-2e53b50649f9 tempest-AttachVolumeNegativeTest-621359088 None] Acquiring lock "cinder-quobyte-c4e43372-bcb2-48e1-8bbd-ed20f965f6d3" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:03 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3e942c89-de68-45c0-818b-2e53b50649f9 tempest-AttachVolumeNegativeTest-621359088 None] Lock "cinder-quobyte-c4e43372-bcb2-48e1-8bbd-ed20f965f6d3" acquired by "delete_volume" :: waited 0.071s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:03 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[347512b2-8d55-4989-a90b-3eaaa97ca753]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3e942c89-de68-45c0-818b-2e53b50649f9 tempest-AttachVolumeNegativeTest-621359088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c4e43372-bcb2-48e1-8bbd-ed20f965f6d3 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:03 devstack sudo[95819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c4e43372-bcb2-48e1-8bbd-ed20f965f6d3 Nov 03 13:13:03 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:04 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3e942c89-de68-45c0-818b-2e53b50649f9 tempest-AttachVolumeNegativeTest-621359088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c4e43372-bcb2-48e1-8bbd-ed20f965f6d3" returned: 0 in 1.040s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3e942c89-de68-45c0-818b-2e53b50649f9 tempest-AttachVolumeNegativeTest-621359088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c4e43372-bcb2-48e1-8bbd-ed20f965f6d3 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:04 devstack sudo[95824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c4e43372-bcb2-48e1-8bbd-ed20f965f6d3 Nov 03 13:13:04 devstack sudo[95824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:04 devstack sudo[95824]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3e942c89-de68-45c0-818b-2e53b50649f9 tempest-AttachVolumeNegativeTest-621359088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c4e43372-bcb2-48e1-8bbd-ed20f965f6d3" returned: 0 in 0.561s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:04 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3e942c89-de68-45c0-818b-2e53b50649f9 tempest-AttachVolumeNegativeTest-621359088 None] Lock "cinder-quobyte-c4e43372-bcb2-48e1-8bbd-ed20f965f6d3" released by "delete_volume" :: held 1.732s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:04 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-3e942c89-de68-45c0-818b-2e53b50649f9 tempest-AttachVolumeNegativeTest-621359088 None] Created reservations ['25164597-b78c-477c-b4ac-28c4fedf16d3', '1778d8df-75e8-403f-9a7b-929244edc03c', '4d40b15a-672e-4ae6-bee1-c650d0657c39', '943fdcc8-2c7b-463d-b14e-3664f0aca7b5'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3e942c89-de68-45c0-818b-2e53b50649f9 tempest-AttachVolumeNegativeTest-621359088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3e942c89-de68-45c0-818b-2e53b50649f9 tempest-AttachVolumeNegativeTest-621359088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:05 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3e942c89-de68-45c0-818b-2e53b50649f9 tempest-AttachVolumeNegativeTest-621359088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:05 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3e942c89-de68-45c0-818b-2e53b50649f9 tempest-AttachVolumeNegativeTest-621359088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3e942c89-de68-45c0-818b-2e53b50649f9 tempest-AttachVolumeNegativeTest-621359088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3e942c89-de68-45c0-818b-2e53b50649f9 tempest-AttachVolumeNegativeTest-621359088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:05 devstack sudo[95828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:13:05 devstack sudo[95828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:06 devstack sudo[95828]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3e942c89-de68-45c0-818b-2e53b50649f9 tempest-AttachVolumeNegativeTest-621359088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 1.271s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:06 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3e942c89-de68-45c0-818b-2e53b50649f9 tempest-AttachVolumeNegativeTest-621359088 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:06 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-3e942c89-de68-45c0-818b-2e53b50649f9 tempest-AttachVolumeNegativeTest-621359088 None] Deleted volume successfully. Nov 03 13:13:06 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3e942c89-de68-45c0-818b-2e53b50649f9 tempest-AttachVolumeNegativeTest-621359088 None] Lock "cinder-c4e43372-bcb2-48e1-8bbd-ed20f965f6d3-delete_volume" released by "delete_volume" :: held 3.777s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:08 devstack sudo[95785]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3ab6e545-3549-45bc-b4cd-df284569842d" returned: 0 in 11.605s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:08 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e, size 1024.00 MB, duration 11.61 sec, destination /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3ab6e545-3549-45bc-b4cd-df284569842d {{(pid=86725) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:13:08 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Converted 1024.00 MB image at 88.23 MB/s Nov 03 13:13:08 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3ab6e545-3549-45bc-b4cd-df284569842d is being set with open permissions: ugo+rw Nov 03 13:13:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3ab6e545-3549-45bc-b4cd-df284569842d {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:08 devstack sudo[95832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3ab6e545-3549-45bc-b4cd-df284569842d Nov 03 13:13:08 devstack sudo[95832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:09 devstack sudo[95832]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3ab6e545-3549-45bc-b4cd-df284569842d" returned: 0 in 0.328s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:09 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Lock "cinder-quobyte-3ab6e545-3549-45bc-b4cd-df284569842d" released by "_copy_volume_from_snapshot" :: held 13.371s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:09 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Acquiring lock "cinder-quobyte-238d5d76-b5c4-4911-af58-960ee7c75fc1" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:09 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Lock "cinder-quobyte-238d5d76-b5c4-4911-af58-960ee7c75fc1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:09 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Deleting offline snapshot 238d5d76-b5c4-4911-af58-960ee7c75fc1 of volume 835adc47-bb06-4be8-a197-aceb34d31b1e {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:13:09 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] snapshot_file for this snap is: volume-835adc47-bb06-4be8-a197-aceb34d31b1e.238d5d76-b5c4-4911-af58-960ee7c75fc1 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:13:09 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1482a73-3adc-4d2f-ae40-02cc95e66f89]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e.238d5d76-b5c4-4911-af58-960ee7c75fc1 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:09 devstack sudo[95839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e.238d5d76-b5c4-4911-af58-960ee7c75fc1 Nov 03 13:13:09 devstack sudo[95839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:09 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-9311419d-6ddd-4caf-8234-c7a7000b508a req-2d00b342-628d-48cc-83bd-cde349144210 tempest-ServerActionsTestOtherA-2024956670 None] Terminate volume connection completed successfully. Nov 03 13:13:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-9311419d-6ddd-4caf-8234-c7a7000b508a req-2d00b342-628d-48cc-83bd-cde349144210 tempest-ServerActionsTestOtherA-2024956670 None] Deleting attachment b6305cad-18d5-464d-a191-d8ede80a9220. {{(pid=86725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:13:09 devstack sudo[95839]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e.238d5d76-b5c4-4911-af58-960ee7c75fc1" returned: 0 in 0.663s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:09 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-835adc47-bb06-4be8-a197-aceb34d31b1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:13:09 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32f5454-957b-4869-9795-56f3943fcedc]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:09 devstack sudo[95888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e Nov 03 13:13:09 devstack sudo[95888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:10 devstack sudo[95888]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e" returned: 0 in 0.625s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e.238d5d76-b5c4-4911-af58-960ee7c75fc1 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:10 devstack sudo[95893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e.238d5d76-b5c4-4911-af58-960ee7c75fc1 Nov 03 13:13:10 devstack sudo[95893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:10 devstack sudo[95893]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e.238d5d76-b5c4-4911-af58-960ee7c75fc1" returned: 0 in 0.412s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e.238d5d76-b5c4-4911-af58-960ee7c75fc1 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:10 devstack sudo[95899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e.238d5d76-b5c4-4911-af58-960ee7c75fc1 Nov 03 13:13:10 devstack sudo[95899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:11 devstack sudo[95899]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e.238d5d76-b5c4-4911-af58-960ee7c75fc1" returned: 0 in 0.275s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:11 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Lock "cinder-quobyte-238d5d76-b5c4-4911-af58-960ee7c75fc1" released by "_delete_snapshot" :: held 2.110s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.774s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d684ab1f-b856-430d-bfcb-3eeb60ceafe0 tempest-SnapshotsActionsTest-1901950821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 16.759s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:11 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a122d3-cc17-494c-8e21-6b0bc8e1acc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ab6e545-3549-45bc-b4cd-df284569842d', 'volume_size': 1, 'source_volid': '835adc47-bb06-4be8-a197-aceb34d31b1e', 'source_volstatus': 'available'}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:11 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d1f0933-dac1-4f0f-a608-f675bc02bd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:11 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-d684ab1f-b856-430d-bfcb-3eeb60ceafe0 tempest-SnapshotsActionsTest-1901950821 None] Creating offline snapshot 9afbe47f-a079-41e6-afe0-019db4a4bd2b of volume df335671-3489-48ff-bbaa-661bdd13b332 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:13:11 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Volume volume-3ab6e545-3549-45bc-b4cd-df284569842d (3ab6e545-3549-45bc-b4cd-df284569842d): created successfully Nov 03 13:13:11 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d1f0933-dac1-4f0f-a608-f675bc02bd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:11 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Flow 'volume_create_manager' (c6994dda-8759-4307-b082-de45445600c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:11 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[584b6dbb-5c15-4d33-9fb5-3fa22b8620c3]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d684ab1f-b856-430d-bfcb-3eeb60ceafe0 tempest-SnapshotsActionsTest-1901950821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-9311419d-6ddd-4caf-8234-c7a7000b508a req-1bcf025b-2ba3-400a-a1c1-3c16a191a32a tempest-ServerActionsTestOtherA-2024956670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:11 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-1fd877a6-fa6e-4bd4-88ae-0fe2be05b7dd tempest-VolumesGetTest-2074296944 None] Created volume successfully. Nov 03 13:13:11 devstack sudo[95910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 Nov 03 13:13:11 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:11 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d684ab1f-b856-430d-bfcb-3eeb60ceafe0 tempest-SnapshotsActionsTest-1901950821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316" returned: 0 in 0.386s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:11 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-d684ab1f-b856-430d-bfcb-3eeb60ceafe0 tempest-SnapshotsActionsTest-1901950821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df335671-3489-48ff-bbaa-661bdd13b332(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:13:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d684ab1f-b856-430d-bfcb-3eeb60ceafe0 tempest-SnapshotsActionsTest-1901950821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.9afbe47f-a079-41e6-afe0-019db4a4bd2b 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:11 devstack sudo[95916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.9afbe47f-a079-41e6-afe0-019db4a4bd2b 1G Nov 03 13:13:11 devstack sudo[95916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:12 devstack sudo[95916]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d684ab1f-b856-430d-bfcb-3eeb60ceafe0 tempest-SnapshotsActionsTest-1901950821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.9afbe47f-a079-41e6-afe0-019db4a4bd2b 1G" returned: 0 in 0.515s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d684ab1f-b856-430d-bfcb-3eeb60ceafe0 tempest-SnapshotsActionsTest-1901950821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.9afbe47f-a079-41e6-afe0-019db4a4bd2b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:12 devstack sudo[95922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.9afbe47f-a079-41e6-afe0-019db4a4bd2b Nov 03 13:13:12 devstack sudo[95922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:12 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:13:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] Flow 'volume_create_manager' (c17bdafb-e59f-4f38-b006-59f4c8838d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe11a9a5-9ce9-404e-b7ab-6d3fded5e8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe11a9a5-9ce9-404e-b7ab-6d3fded5e8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-519144263',display_name='tempest-VolumesGetTest-Volume-331730183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce50d016-6d4a-4d55-b0c9-c1c39f75971b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9522a11a75cf44bc84765823c173de83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:13Z,use_quota=True,user_id='fd4dfb10072d401385a629c2ba422dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e3bca8-e867-42f0-9fd6-84b70253ddb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e3bca8-e867-42f0-9fd6-84b70253ddb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af067707-e142-4b40-a721-025403a2ec70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:12 devstack sudo[95922]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af067707-e142-4b40-a721-025403a2ec70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce50d016-6d4a-4d55-b0c9-c1c39f75971b', 'volume_name': 'volume-ce50d016-6d4a-4d55-b0c9-c1c39f75971b', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6212451-3f06-4250-bbfe-afaed2cbdb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6212451-3f06-4250-bbfe-afaed2cbdb41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c2396e6-8189-4f17-a4c1-26ec6962c7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:12 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] Volume ce50d016-6d4a-4d55-b0c9-c1c39f75971b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce50d016-6d4a-4d55-b0c9-c1c39f75971b', 'volume_size': 1} Nov 03 13:13:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d684ab1f-b856-430d-bfcb-3eeb60ceafe0 tempest-SnapshotsActionsTest-1901950821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.9afbe47f-a079-41e6-afe0-019db4a4bd2b" returned: 0 in 0.460s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:12 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-d684ab1f-b856-430d-bfcb-3eeb60ceafe0 tempest-SnapshotsActionsTest-1901950821 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.9afbe47f-a079-41e6-afe0-019db4a4bd2b is being set with open permissions: ugo+rw Nov 03 13:13:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d684ab1f-b856-430d-bfcb-3eeb60ceafe0 tempest-SnapshotsActionsTest-1901950821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.9afbe47f-a079-41e6-afe0-019db4a4bd2b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:12 devstack sudo[95928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.9afbe47f-a079-41e6-afe0-019db4a4bd2b Nov 03 13:13:12 devstack sudo[95928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:12 devstack sudo[95928]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d684ab1f-b856-430d-bfcb-3eeb60ceafe0 tempest-SnapshotsActionsTest-1901950821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.9afbe47f-a079-41e6-afe0-019db4a4bd2b" returned: 0 in 0.242s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d684ab1f-b856-430d-bfcb-3eeb60ceafe0 tempest-SnapshotsActionsTest-1901950821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.783s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-9311419d-6ddd-4caf-8234-c7a7000b508a req-1bcf025b-2ba3-400a-a1c1-3c16a191a32a tempest-ServerActionsTestOtherA-2024956670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.646s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-9311419d-6ddd-4caf-8234-c7a7000b508a req-1bcf025b-2ba3-400a-a1c1-3c16a191a32a tempest-ServerActionsTestOtherA-2024956670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.324s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-519144263',display_name='tempest-VolumesGetTest-Volume-331730183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce50d016-6d4a-4d55-b0c9-c1c39f75971b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9522a11a75cf44bc84765823c173de83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:13Z,use_quota=True,user_id='fd4dfb10072d401385a629c2ba422dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:13:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] Creating volume ce50d016-6d4a-4d55-b0c9-c1c39f75971b {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:13:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:13:13 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:13:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ce50d016-6d4a-4d55-b0c9-c1c39f75971b 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:13 devstack sudo[95931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ce50d016-6d4a-4d55-b0c9-c1c39f75971b 1073741824 Nov 03 13:13:13 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:13 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-d684ab1f-b856-430d-bfcb-3eeb60ceafe0 tempest-SnapshotsActionsTest-1901950821 None] Create snapshot completed successfully Nov 03 13:13:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-9311419d-6ddd-4caf-8234-c7a7000b508a req-1bcf025b-2ba3-400a-a1c1-3c16a191a32a tempest-ServerActionsTestOtherA-2024956670 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43', 'name': 'volume-4ef6494c-6050-43f3-a045-8482e64733b0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '81f6ce00-1650-4dc6-bc22-95b6f42e351a', 'enforce_multipath': True} {{(pid=86725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:13:13 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-9311419d-6ddd-4caf-8234-c7a7000b508a req-1bcf025b-2ba3-400a-a1c1-3c16a191a32a tempest-ServerActionsTestOtherA-2024956670 None] attachment_update completed successfully. Nov 03 13:13:13 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ce50d016-6d4a-4d55-b0c9-c1c39f75971b 1073741824" returned: 0 in 0.604s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ce50d016-6d4a-4d55-b0c9-c1c39f75971b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:13 devstack sudo[96014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ce50d016-6d4a-4d55-b0c9-c1c39f75971b Nov 03 13:13:13 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:14 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ce50d016-6d4a-4d55-b0c9-c1c39f75971b" returned: 0 in 0.360s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:14 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:13:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c2396e6-8189-4f17-a4c1-26ec6962c7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce50d016-6d4a-4d55-b0c9-c1c39f75971b', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282afbc9-327b-43fe-b112-d3aa560dc701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:14 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] Volume volume-ce50d016-6d4a-4d55-b0c9-c1c39f75971b (ce50d016-6d4a-4d55-b0c9-c1c39f75971b): created successfully Nov 03 13:13:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282afbc9-327b-43fe-b112-d3aa560dc701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] Flow 'volume_create_manager' (c17bdafb-e59f-4f38-b006-59f4c8838d4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:14 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-6a8859e4-2322-4d34-a09f-462fcc9d70b8 tempest-VolumesGetTest-2074296944 None] Created volume successfully. Nov 03 13:13:14 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3bbff63d-2e5f-4ce6-a6cd-fd02b1df3cea tempest-SnapshotsActionsTest-1540369714 None] Acquiring lock "cinder-9afbe47f-a079-41e6-afe0-019db4a4bd2b-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:14 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3bbff63d-2e5f-4ce6-a6cd-fd02b1df3cea tempest-SnapshotsActionsTest-1540369714 None] Lock "cinder-9afbe47f-a079-41e6-afe0-019db4a4bd2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:14 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3bbff63d-2e5f-4ce6-a6cd-fd02b1df3cea tempest-SnapshotsActionsTest-1540369714 None] Acquiring lock "cinder-quobyte-df335671-3489-48ff-bbaa-661bdd13b332" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:14 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3bbff63d-2e5f-4ce6-a6cd-fd02b1df3cea tempest-SnapshotsActionsTest-1540369714 None] Lock "cinder-quobyte-df335671-3489-48ff-bbaa-661bdd13b332" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:14 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3bbff63d-2e5f-4ce6-a6cd-fd02b1df3cea tempest-SnapshotsActionsTest-1540369714 None] Acquiring lock "cinder-quobyte-9afbe47f-a079-41e6-afe0-019db4a4bd2b" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:14 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3bbff63d-2e5f-4ce6-a6cd-fd02b1df3cea tempest-SnapshotsActionsTest-1540369714 None] Lock "cinder-quobyte-9afbe47f-a079-41e6-afe0-019db4a4bd2b" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:14 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-3bbff63d-2e5f-4ce6-a6cd-fd02b1df3cea tempest-SnapshotsActionsTest-1540369714 None] Deleting offline snapshot 9afbe47f-a079-41e6-afe0-019db4a4bd2b of volume df335671-3489-48ff-bbaa-661bdd13b332 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:13:14 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-3bbff63d-2e5f-4ce6-a6cd-fd02b1df3cea tempest-SnapshotsActionsTest-1540369714 None] snapshot_file for this snap is: volume-df335671-3489-48ff-bbaa-661bdd13b332.9afbe47f-a079-41e6-afe0-019db4a4bd2b {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:13:14 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a47513-87fa-431e-8297-7d0e2e9ef8fc]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3bbff63d-2e5f-4ce6-a6cd-fd02b1df3cea tempest-SnapshotsActionsTest-1540369714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.9afbe47f-a079-41e6-afe0-019db4a4bd2b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:14 devstack sudo[96379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.9afbe47f-a079-41e6-afe0-019db4a4bd2b Nov 03 13:13:14 devstack sudo[96379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:14 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4b6f02a3-e0c0-4476-8169-1dc9fb091582 tempest-VolumesGetTest-2074296944 None] Acquiring lock "cinder-ce50d016-6d4a-4d55-b0c9-c1c39f75971b-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:15 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4b6f02a3-e0c0-4476-8169-1dc9fb091582 tempest-VolumesGetTest-2074296944 None] Lock "cinder-ce50d016-6d4a-4d55-b0c9-c1c39f75971b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:15 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4b6f02a3-e0c0-4476-8169-1dc9fb091582 tempest-VolumesGetTest-2074296944 None] Acquiring lock "cinder-quobyte-ce50d016-6d4a-4d55-b0c9-c1c39f75971b" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:15 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4b6f02a3-e0c0-4476-8169-1dc9fb091582 tempest-VolumesGetTest-2074296944 None] Lock "cinder-quobyte-ce50d016-6d4a-4d55-b0c9-c1c39f75971b" acquired by "delete_volume" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:15 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54088c9-8d43-46f7-87f4-04819be45314]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4b6f02a3-e0c0-4476-8169-1dc9fb091582 tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ce50d016-6d4a-4d55-b0c9-c1c39f75971b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:15 devstack sudo[96379]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3bbff63d-2e5f-4ce6-a6cd-fd02b1df3cea tempest-SnapshotsActionsTest-1540369714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.9afbe47f-a079-41e6-afe0-019db4a4bd2b" returned: 0 in 0.774s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:15 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-3bbff63d-2e5f-4ce6-a6cd-fd02b1df3cea tempest-SnapshotsActionsTest-1540369714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df335671-3489-48ff-bbaa-661bdd13b332(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:13:15 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdb938b-33c5-4023-a9a9-4acc0cb28ac7]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3bbff63d-2e5f-4ce6-a6cd-fd02b1df3cea tempest-SnapshotsActionsTest-1540369714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:15 devstack sudo[96397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ce50d016-6d4a-4d55-b0c9-c1c39f75971b Nov 03 13:13:15 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:15 devstack sudo[96400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 Nov 03 13:13:15 devstack sudo[96400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:15 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4b6f02a3-e0c0-4476-8169-1dc9fb091582 tempest-VolumesGetTest-2074296944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ce50d016-6d4a-4d55-b0c9-c1c39f75971b" returned: 0 in 0.502s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4b6f02a3-e0c0-4476-8169-1dc9fb091582 tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ce50d016-6d4a-4d55-b0c9-c1c39f75971b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:15 devstack sudo[96406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ce50d016-6d4a-4d55-b0c9-c1c39f75971b Nov 03 13:13:15 devstack sudo[96406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:15 devstack sudo[96400]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3bbff63d-2e5f-4ce6-a6cd-fd02b1df3cea tempest-SnapshotsActionsTest-1540369714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316" returned: 0 in 0.511s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:15 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-3bbff63d-2e5f-4ce6-a6cd-fd02b1df3cea tempest-SnapshotsActionsTest-1540369714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df335671-3489-48ff-bbaa-661bdd13b332(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:13:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3bbff63d-2e5f-4ce6-a6cd-fd02b1df3cea tempest-SnapshotsActionsTest-1540369714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.9afbe47f-a079-41e6-afe0-019db4a4bd2b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:15 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.9afbe47f-a079-41e6-afe0-019db4a4bd2b Nov 03 13:13:15 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:16 devstack sudo[96406]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4b6f02a3-e0c0-4476-8169-1dc9fb091582 tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ce50d016-6d4a-4d55-b0c9-c1c39f75971b" returned: 0 in 0.348s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:16 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4b6f02a3-e0c0-4476-8169-1dc9fb091582 tempest-VolumesGetTest-2074296944 None] Lock "cinder-quobyte-ce50d016-6d4a-4d55-b0c9-c1c39f75971b" released by "delete_volume" :: held 0.939s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:16 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-4b6f02a3-e0c0-4476-8169-1dc9fb091582 tempest-VolumesGetTest-2074296944 None] Created reservations ['0607f674-0600-42df-a3ba-f7e951a67ea8', '63d9f8b3-539f-46f1-96fb-b5fed9cc90fd', '875980a2-2a20-4fb5-a84f-8134ced06500', '956aff8c-45f6-404a-84dc-c492216dd332'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4b6f02a3-e0c0-4476-8169-1dc9fb091582 tempest-VolumesGetTest-2074296944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4b6f02a3-e0c0-4476-8169-1dc9fb091582 tempest-VolumesGetTest-2074296944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:16 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4b6f02a3-e0c0-4476-8169-1dc9fb091582 tempest-VolumesGetTest-2074296944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:16 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4b6f02a3-e0c0-4476-8169-1dc9fb091582 tempest-VolumesGetTest-2074296944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4b6f02a3-e0c0-4476-8169-1dc9fb091582 tempest-VolumesGetTest-2074296944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4b6f02a3-e0c0-4476-8169-1dc9fb091582 tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:16 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3bbff63d-2e5f-4ce6-a6cd-fd02b1df3cea tempest-SnapshotsActionsTest-1540369714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.9afbe47f-a079-41e6-afe0-019db4a4bd2b" returned: 0 in 0.696s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:16 devstack sudo[96420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:13:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3bbff63d-2e5f-4ce6-a6cd-fd02b1df3cea tempest-SnapshotsActionsTest-1540369714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.9afbe47f-a079-41e6-afe0-019db4a4bd2b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:16 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:16 devstack sudo[96422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.9afbe47f-a079-41e6-afe0-019db4a4bd2b Nov 03 13:13:16 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:16 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4b6f02a3-e0c0-4476-8169-1dc9fb091582 tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.404s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:16 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-4b6f02a3-e0c0-4476-8169-1dc9fb091582 tempest-VolumesGetTest-2074296944 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:16 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-4b6f02a3-e0c0-4476-8169-1dc9fb091582 tempest-VolumesGetTest-2074296944 None] Deleted volume successfully. Nov 03 13:13:16 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:16 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4b6f02a3-e0c0-4476-8169-1dc9fb091582 tempest-VolumesGetTest-2074296944 None] Lock "cinder-ce50d016-6d4a-4d55-b0c9-c1c39f75971b-delete_volume" released by "delete_volume" :: held 1.931s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3bbff63d-2e5f-4ce6-a6cd-fd02b1df3cea tempest-SnapshotsActionsTest-1540369714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.9afbe47f-a079-41e6-afe0-019db4a4bd2b" returned: 0 in 0.388s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:16 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3bbff63d-2e5f-4ce6-a6cd-fd02b1df3cea tempest-SnapshotsActionsTest-1540369714 None] Lock "cinder-quobyte-9afbe47f-a079-41e6-afe0-019db4a4bd2b" released by "_delete_snapshot" :: held 2.556s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:16 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3bbff63d-2e5f-4ce6-a6cd-fd02b1df3cea tempest-SnapshotsActionsTest-1540369714 None] Lock "cinder-quobyte-df335671-3489-48ff-bbaa-661bdd13b332" released by "delete_snapshot" :: held 2.623s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:17 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-3bbff63d-2e5f-4ce6-a6cd-fd02b1df3cea tempest-SnapshotsActionsTest-1540369714 None] Created reservations ['ae6ee367-bd26-4d59-a468-f115a21f8253', 'c572a5a8-3394-4246-bb92-21933212b644', '17d059d0-984c-4270-99dd-585aacd7bae3', '899bef96-f3a3-4651-93a7-70bdbc735322'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:17 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-3bbff63d-2e5f-4ce6-a6cd-fd02b1df3cea tempest-SnapshotsActionsTest-1540369714 None] Delete snapshot completed successfully. Nov 03 13:13:17 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3bbff63d-2e5f-4ce6-a6cd-fd02b1df3cea tempest-SnapshotsActionsTest-1540369714 None] Lock "cinder-9afbe47f-a079-41e6-afe0-019db4a4bd2b-delete_snapshot" released by "delete_snapshot" :: held 2.820s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:17 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-ff3499c7-768e-4f74-8aea-13a6a7b8c760 tempest-VolumesGetTest-2074296944 None] Acquiring lock "cinder-3ab6e545-3549-45bc-b4cd-df284569842d-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:17 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-ff3499c7-768e-4f74-8aea-13a6a7b8c760 tempest-VolumesGetTest-2074296944 None] Lock "cinder-3ab6e545-3549-45bc-b4cd-df284569842d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:17 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-ff3499c7-768e-4f74-8aea-13a6a7b8c760 tempest-VolumesGetTest-2074296944 None] Acquiring lock "cinder-quobyte-3ab6e545-3549-45bc-b4cd-df284569842d" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:17 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-ff3499c7-768e-4f74-8aea-13a6a7b8c760 tempest-VolumesGetTest-2074296944 None] Lock "cinder-quobyte-3ab6e545-3549-45bc-b4cd-df284569842d" acquired by "delete_volume" :: waited 0.034s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:17 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[9830ad71-122b-424e-8374-5bb335e200b7]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ff3499c7-768e-4f74-8aea-13a6a7b8c760 tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3ab6e545-3549-45bc-b4cd-df284569842d {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:17 devstack sudo[96426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3ab6e545-3549-45bc-b4cd-df284569842d Nov 03 13:13:17 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:18 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ff3499c7-768e-4f74-8aea-13a6a7b8c760 tempest-VolumesGetTest-2074296944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3ab6e545-3549-45bc-b4cd-df284569842d" returned: 0 in 0.736s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ff3499c7-768e-4f74-8aea-13a6a7b8c760 tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3ab6e545-3549-45bc-b4cd-df284569842d {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:18 devstack sudo[96431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3ab6e545-3549-45bc-b4cd-df284569842d Nov 03 13:13:18 devstack sudo[96431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:18 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5a1031dc-9e05-4b72-83bb-7fcddb25db41 tempest-SnapshotsActionsTest-1901950821 None] Acquiring lock "cinder-795c6b09-433c-439c-970e-d5f5d37b0316-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:18 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5a1031dc-9e05-4b72-83bb-7fcddb25db41 tempest-SnapshotsActionsTest-1901950821 None] Lock "cinder-795c6b09-433c-439c-970e-d5f5d37b0316-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:18 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5a1031dc-9e05-4b72-83bb-7fcddb25db41 tempest-SnapshotsActionsTest-1901950821 None] Acquiring lock "cinder-quobyte-df335671-3489-48ff-bbaa-661bdd13b332" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:18 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5a1031dc-9e05-4b72-83bb-7fcddb25db41 tempest-SnapshotsActionsTest-1901950821 None] Lock "cinder-quobyte-df335671-3489-48ff-bbaa-661bdd13b332" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:18 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5a1031dc-9e05-4b72-83bb-7fcddb25db41 tempest-SnapshotsActionsTest-1901950821 None] Acquiring lock "cinder-quobyte-795c6b09-433c-439c-970e-d5f5d37b0316" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:18 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5a1031dc-9e05-4b72-83bb-7fcddb25db41 tempest-SnapshotsActionsTest-1901950821 None] Lock "cinder-quobyte-795c6b09-433c-439c-970e-d5f5d37b0316" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:18 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-5a1031dc-9e05-4b72-83bb-7fcddb25db41 tempest-SnapshotsActionsTest-1901950821 None] Deleting offline snapshot 795c6b09-433c-439c-970e-d5f5d37b0316 of volume df335671-3489-48ff-bbaa-661bdd13b332 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:13:18 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-5a1031dc-9e05-4b72-83bb-7fcddb25db41 tempest-SnapshotsActionsTest-1901950821 None] snapshot_file for this snap is: volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:13:18 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[b915db30-14e6-4eee-be3a-ef9c177ec61b]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5a1031dc-9e05-4b72-83bb-7fcddb25db41 tempest-SnapshotsActionsTest-1901950821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:18 devstack sudo[96431]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ff3499c7-768e-4f74-8aea-13a6a7b8c760 tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3ab6e545-3549-45bc-b4cd-df284569842d" returned: 0 in 0.525s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:19 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-ff3499c7-768e-4f74-8aea-13a6a7b8c760 tempest-VolumesGetTest-2074296944 None] Lock "cinder-quobyte-3ab6e545-3549-45bc-b4cd-df284569842d" released by "delete_volume" :: held 1.366s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:19 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-ff3499c7-768e-4f74-8aea-13a6a7b8c760 tempest-VolumesGetTest-2074296944 None] Created reservations ['6e28eee2-b811-44ad-9c96-1922cce11c7b', 'ecbb3f6a-7409-4a13-87dd-dc5da11302e2', 'e2926753-3ee7-4cc2-853b-46c81c330ffa', '4048f361-1bdd-4588-ac54-9020f1920fd6'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:19 devstack sudo[96435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 Nov 03 13:13:19 devstack sudo[96435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ff3499c7-768e-4f74-8aea-13a6a7b8c760 tempest-VolumesGetTest-2074296944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ff3499c7-768e-4f74-8aea-13a6a7b8c760 tempest-VolumesGetTest-2074296944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:19 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ff3499c7-768e-4f74-8aea-13a6a7b8c760 tempest-VolumesGetTest-2074296944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:19 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ff3499c7-768e-4f74-8aea-13a6a7b8c760 tempest-VolumesGetTest-2074296944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ff3499c7-768e-4f74-8aea-13a6a7b8c760 tempest-VolumesGetTest-2074296944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ff3499c7-768e-4f74-8aea-13a6a7b8c760 tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:19 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:13:19 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:19 devstack sudo[96435]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5a1031dc-9e05-4b72-83bb-7fcddb25db41 tempest-SnapshotsActionsTest-1901950821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316" returned: 0 in 0.610s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:19 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-5a1031dc-9e05-4b72-83bb-7fcddb25db41 tempest-SnapshotsActionsTest-1901950821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df335671-3489-48ff-bbaa-661bdd13b332(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:13:19 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bb533d-f9f0-45a1-ad37-809e0526d385]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5a1031dc-9e05-4b72-83bb-7fcddb25db41 tempest-SnapshotsActionsTest-1901950821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:19 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ff3499c7-768e-4f74-8aea-13a6a7b8c760 tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.442s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:19 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-ff3499c7-768e-4f74-8aea-13a6a7b8c760 tempest-VolumesGetTest-2074296944 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:19 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-ff3499c7-768e-4f74-8aea-13a6a7b8c760 tempest-VolumesGetTest-2074296944 None] Deleted volume successfully. Nov 03 13:13:19 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-ff3499c7-768e-4f74-8aea-13a6a7b8c760 tempest-VolumesGetTest-2074296944 None] Lock "cinder-3ab6e545-3549-45bc-b4cd-df284569842d-delete_volume" released by "delete_volume" :: held 2.199s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:19 devstack sudo[96444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332 Nov 03 13:13:19 devstack sudo[96444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:20 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-086dc800-596c-4a35-861a-922e6701b9d4 tempest-VolumesGetTest-2074296944 None] Acquiring lock "cinder-835adc47-bb06-4be8-a197-aceb34d31b1e-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:20 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-086dc800-596c-4a35-861a-922e6701b9d4 tempest-VolumesGetTest-2074296944 None] Lock "cinder-835adc47-bb06-4be8-a197-aceb34d31b1e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:20 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-086dc800-596c-4a35-861a-922e6701b9d4 tempest-VolumesGetTest-2074296944 None] Acquiring lock "cinder-quobyte-835adc47-bb06-4be8-a197-aceb34d31b1e" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:20 devstack sudo[96444]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5a1031dc-9e05-4b72-83bb-7fcddb25db41 tempest-SnapshotsActionsTest-1901950821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332" returned: 0 in 0.653s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5a1031dc-9e05-4b72-83bb-7fcddb25db41 tempest-SnapshotsActionsTest-1901950821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:20 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-086dc800-596c-4a35-861a-922e6701b9d4 tempest-VolumesGetTest-2074296944 None] Lock "cinder-quobyte-835adc47-bb06-4be8-a197-aceb34d31b1e" acquired by "delete_volume" :: waited 0.067s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:20 devstack sudo[96449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 Nov 03 13:13:20 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:20 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6875c0e-0c85-4492-ab5e-0f853a920ca5]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-086dc800-596c-4a35-861a-922e6701b9d4 tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:20 devstack sudo[96451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e Nov 03 13:13:20 devstack sudo[96451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:21 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5a1031dc-9e05-4b72-83bb-7fcddb25db41 tempest-SnapshotsActionsTest-1901950821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316" returned: 0 in 0.836s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5a1031dc-9e05-4b72-83bb-7fcddb25db41 tempest-SnapshotsActionsTest-1901950821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:21 devstack sudo[96458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316 Nov 03 13:13:21 devstack sudo[96458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:21 devstack sudo[96451]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-086dc800-596c-4a35-861a-922e6701b9d4 tempest-VolumesGetTest-2074296944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e" returned: 0 in 0.829s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-086dc800-596c-4a35-861a-922e6701b9d4 tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:21 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e Nov 03 13:13:21 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:21 devstack sudo[96458]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5a1031dc-9e05-4b72-83bb-7fcddb25db41 tempest-SnapshotsActionsTest-1901950821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332.795c6b09-433c-439c-970e-d5f5d37b0316" returned: 0 in 0.721s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:21 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5a1031dc-9e05-4b72-83bb-7fcddb25db41 tempest-SnapshotsActionsTest-1901950821 None] Lock "cinder-quobyte-795c6b09-433c-439c-970e-d5f5d37b0316" released by "_delete_snapshot" :: held 3.052s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:21 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5a1031dc-9e05-4b72-83bb-7fcddb25db41 tempest-SnapshotsActionsTest-1901950821 None] Lock "cinder-quobyte-df335671-3489-48ff-bbaa-661bdd13b332" released by "delete_snapshot" :: held 3.098s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:22 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-086dc800-596c-4a35-861a-922e6701b9d4 tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-835adc47-bb06-4be8-a197-aceb34d31b1e" returned: 0 in 0.767s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:22 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-086dc800-596c-4a35-861a-922e6701b9d4 tempest-VolumesGetTest-2074296944 None] Lock "cinder-quobyte-835adc47-bb06-4be8-a197-aceb34d31b1e" released by "delete_volume" :: held 1.742s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:22 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-5a1031dc-9e05-4b72-83bb-7fcddb25db41 tempest-SnapshotsActionsTest-1901950821 None] Created reservations ['f3ea45dd-a7fd-439f-a61b-570162cff346', 'c35d0b93-6a1c-4e58-aa61-7cbf99696aef', 'acfde281-c9b5-4a85-b226-00b12767b2e7', '29573150-65e6-43b8-83d9-230f6a3d6ec3'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:22 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-086dc800-596c-4a35-861a-922e6701b9d4 tempest-VolumesGetTest-2074296944 None] Created reservations ['b9c87aaf-e7e9-4a0b-bc93-4e09b8eb6a96', 'c35d9a5c-4089-4bec-a5d0-7b2a454f6c59', 'ea198975-dde9-4982-8711-9c7c370dba72', 'f87e411f-dfcb-48aa-a97a-5599478a01ce'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:22 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-5a1031dc-9e05-4b72-83bb-7fcddb25db41 tempest-SnapshotsActionsTest-1901950821 None] Delete snapshot completed successfully. Nov 03 13:13:22 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5a1031dc-9e05-4b72-83bb-7fcddb25db41 tempest-SnapshotsActionsTest-1901950821 None] Lock "cinder-795c6b09-433c-439c-970e-d5f5d37b0316-delete_snapshot" released by "delete_snapshot" :: held 3.462s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-086dc800-596c-4a35-861a-922e6701b9d4 tempest-VolumesGetTest-2074296944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-086dc800-596c-4a35-861a-922e6701b9d4 tempest-VolumesGetTest-2074296944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:22 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-086dc800-596c-4a35-861a-922e6701b9d4 tempest-VolumesGetTest-2074296944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:22 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-086dc800-596c-4a35-861a-922e6701b9d4 tempest-VolumesGetTest-2074296944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-086dc800-596c-4a35-861a-922e6701b9d4 tempest-VolumesGetTest-2074296944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-086dc800-596c-4a35-861a-922e6701b9d4 tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:22 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:13:22 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:22 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-086dc800-596c-4a35-861a-922e6701b9d4 tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.395s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:22 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-086dc800-596c-4a35-861a-922e6701b9d4 tempest-VolumesGetTest-2074296944 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:22 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-086dc800-596c-4a35-861a-922e6701b9d4 tempest-VolumesGetTest-2074296944 None] Deleted volume successfully. Nov 03 13:13:22 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-086dc800-596c-4a35-861a-922e6701b9d4 tempest-VolumesGetTest-2074296944 None] Lock "cinder-835adc47-bb06-4be8-a197-aceb34d31b1e-delete_volume" released by "delete_volume" :: held 2.603s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:23 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-f34c365d-7265-41d9-80e6-f7b2efa3ccf5 tempest-SnapshotsActionsTest-1901950821 None] Acquiring lock "cinder-df335671-3489-48ff-bbaa-661bdd13b332-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:23 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-f34c365d-7265-41d9-80e6-f7b2efa3ccf5 tempest-SnapshotsActionsTest-1901950821 None] Lock "cinder-df335671-3489-48ff-bbaa-661bdd13b332-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:23 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-f34c365d-7265-41d9-80e6-f7b2efa3ccf5 tempest-SnapshotsActionsTest-1901950821 None] Acquiring lock "cinder-quobyte-df335671-3489-48ff-bbaa-661bdd13b332" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:23 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-f34c365d-7265-41d9-80e6-f7b2efa3ccf5 tempest-SnapshotsActionsTest-1901950821 None] Lock "cinder-quobyte-df335671-3489-48ff-bbaa-661bdd13b332" acquired by "delete_volume" :: waited 0.021s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:23 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfe6837-4418-439b-adcc-b1ca5f89a44d]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f34c365d-7265-41d9-80e6-f7b2efa3ccf5 tempest-SnapshotsActionsTest-1901950821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:23 devstack sudo[96471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332 Nov 03 13:13:23 devstack sudo[96471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:23 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:13:23 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Flow 'volume_create_manager' (4431a04a-ff75-4101-a705-898d5f723dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:23 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67fc2f38-d4b3-4af7-88a4-5af1c6c750e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:23 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67fc2f38-d4b3-4af7-88a4-5af1c6c750e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-860897274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cda8185a-9c06-43ab-97eb-da0c3aa52a30,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9522a11a75cf44bc84765823c173de83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:24Z,use_quota=True,user_id='fd4dfb10072d401385a629c2ba422dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:23 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (793c2938-8062-4d7e-a3e8-0c6a3ab20d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:23 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (793c2938-8062-4d7e-a3e8-0c6a3ab20d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:23 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0cfa470-c1e6-410c-8bfa-d9c29a9d7c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:23 devstack cinder-volume[86725]: DEBUG cinder.image.glance [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Creating Keystone auth plugin from conf {{(pid=86725) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 13:13:23 devstack sudo[96471]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f34c365d-7265-41d9-80e6-f7b2efa3ccf5 tempest-SnapshotsActionsTest-1901950821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332" returned: 0 in 0.456s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f34c365d-7265-41d9-80e6-f7b2efa3ccf5 tempest-SnapshotsActionsTest-1901950821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:23 devstack sudo[96476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332 Nov 03 13:13:23 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:24 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f34c365d-7265-41d9-80e6-f7b2efa3ccf5 tempest-SnapshotsActionsTest-1901950821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df335671-3489-48ff-bbaa-661bdd13b332" returned: 0 in 0.341s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0cfa470-c1e6-410c-8bfa-d9c29a9d7c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cda8185a-9c06-43ab-97eb-da0c3aa52a30', 'volume_name': 'volume-cda8185a-9c06-43ab-97eb-da0c3aa52a30', 'volume_size': 1, 'image_id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8a9fdfe427f436894d9c81085f9b6d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'created_at': datetime.datetime(2026, 11, 3, 12, 0, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 0, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af5ab2b3-54fc-4b75-83b4-2287b79c8e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af5ab2b3-54fc-4b75-83b4-2287b79c8e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924866e0-9ef6-4e8c-a110-089c48e2ba96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:24 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Volume cda8185a-9c06-43ab-97eb-da0c3aa52a30: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cda8185a-9c06-43ab-97eb-da0c3aa52a30', 'volume_size': 1, 'image_id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8a9fdfe427f436894d9c81085f9b6d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'created_at': datetime.datetime(2026, 11, 3, 12, 0, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 0, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 13:13:24 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Trying to clone cda8185a-9c06-43ab-97eb-da0c3aa52a30 from image d23bcc2f-7dfc-45dc-b259-aec67f909b4f at location (None, [{'url': 'file:///opt/stack/data/glance/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'metadata': {}}]). {{(pid=86725) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 13:13:24 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-f34c365d-7265-41d9-80e6-f7b2efa3ccf5 tempest-SnapshotsActionsTest-1901950821 None] Lock "cinder-quobyte-df335671-3489-48ff-bbaa-661bdd13b332" released by "delete_volume" :: held 0.950s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:24 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:UPDATE=142,cinder:SELECT=149,cinder:INSERT=42,cinder:DELETE=12 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:13:24 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:UPDATE=157,cinder:SELECT=132,cinder:INSERT=43,cinder:DELETE=12 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:13:24 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-f34c365d-7265-41d9-80e6-f7b2efa3ccf5 tempest-SnapshotsActionsTest-1901950821 None] Created reservations ['1a1aea00-c084-42f6-b668-10d7e5137352', '2fe2ec13-58f8-4c63-9d38-84020ecb51f9', '1bd7a64f-2a72-4cd0-ace7-4f54bd3ab2c0', '66fa9340-8a6a-49b5-b208-4c9030570e41'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f34c365d-7265-41d9-80e6-f7b2efa3ccf5 tempest-SnapshotsActionsTest-1901950821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f34c365d-7265-41d9-80e6-f7b2efa3ccf5 tempest-SnapshotsActionsTest-1901950821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:24 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f34c365d-7265-41d9-80e6-f7b2efa3ccf5 tempest-SnapshotsActionsTest-1901950821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:24 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f34c365d-7265-41d9-80e6-f7b2efa3ccf5 tempest-SnapshotsActionsTest-1901950821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f34c365d-7265-41d9-80e6-f7b2efa3ccf5 tempest-SnapshotsActionsTest-1901950821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f34c365d-7265-41d9-80e6-f7b2efa3ccf5 tempest-SnapshotsActionsTest-1901950821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:24 devstack sudo[96488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:13:24 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:25 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_2ptspn7ldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86725) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 13:13:25 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Image download 20.69 MB at 20.69 MB/s Nov 03 13:13:25 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c72ce49-b939-4f45-8ec9-faa1c8a3fdad]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_2ptspn7ldevstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:25 devstack sudo[96492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_2ptspn7ldevstack@QuobyteHD Nov 03 13:13:25 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:25 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f34c365d-7265-41d9-80e6-f7b2efa3ccf5 tempest-SnapshotsActionsTest-1901950821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.558s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:25 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-f34c365d-7265-41d9-80e6-f7b2efa3ccf5 tempest-SnapshotsActionsTest-1901950821 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:25 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-f34c365d-7265-41d9-80e6-f7b2efa3ccf5 tempest-SnapshotsActionsTest-1901950821 None] Deleted volume successfully. Nov 03 13:13:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-f34c365d-7265-41d9-80e6-f7b2efa3ccf5 tempest-SnapshotsActionsTest-1901950821 None] Lock "cinder-df335671-3489-48ff-bbaa-661bdd13b332-delete_volume" released by "delete_volume" :: held 2.082s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:25 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_2ptspn7ldevstack@QuobyteHD" returned: 0 in 0.443s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:25 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Temporary image d23bcc2f-7dfc-45dc-b259-aec67f909b4f is fetched for user fd4dfb10072d401385a629c2ba422dd3. {{(pid=86725) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 13:13:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ca15d049-c3c8-40d6-8df1-543fcf30d0da tempest-BackendsCapabilitiesAdminTestsJSON-1198010092 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7062873840332, 'free_capacity_gb': 1773.7062873840332, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86725) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 13:13:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-395b967d-fe44-4dc1-9aa1-b4e5495190ac tempest-BackendsCapabilitiesAdminTestsJSON-1198010092 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7062873840332, 'free_capacity_gb': 1773.7062873840332, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86725) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 13:13:25 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[abca33d6-f099-433a-a87d-957f7ed693b6]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_2ptspn7ldevstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:25 devstack sudo[96500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_2ptspn7ldevstack@QuobyteHD Nov 03 13:13:25 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:26 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_2ptspn7ldevstack@QuobyteHD" returned: 0 in 0.437s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-860897274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cda8185a-9c06-43ab-97eb-da0c3aa52a30,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9522a11a75cf44bc84765823c173de83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:24Z,use_quota=True,user_id='fd4dfb10072d401385a629c2ba422dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:13:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Creating volume cda8185a-9c06-43ab-97eb-da0c3aa52a30 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:13:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:13:26 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:13:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cda8185a-9c06-43ab-97eb-da0c3aa52a30 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:26 devstack sudo[96506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cda8185a-9c06-43ab-97eb-da0c3aa52a30 1073741824 Nov 03 13:13:26 devstack sudo[96506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:26 devstack sudo[96506]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cda8185a-9c06-43ab-97eb-da0c3aa52a30 1073741824" returned: 0 in 0.577s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cda8185a-9c06-43ab-97eb-da0c3aa52a30 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:26 devstack sudo[96512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cda8185a-9c06-43ab-97eb-da0c3aa52a30 Nov 03 13:13:26 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:27 devstack sudo[96512]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cda8185a-9c06-43ab-97eb-da0c3aa52a30" returned: 0 in 0.479s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:27 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:13:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:27 devstack cinder-volume[86725]: DEBUG cinder.volume.volume_utils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Attempting download of d23bcc2f-7dfc-45dc-b259-aec67f909b4f ((None, [{'url': 'file:///opt/stack/data/glance/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'metadata': {}}])) to volume cda8185a-9c06-43ab-97eb-da0c3aa52a30. {{(pid=86725) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 13:13:27 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eff2d10-e428-45b0-bda4-8e1888e41427]: (4, 'raw') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_5mbwm27l {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:27 devstack sudo[96515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_5mbwm27l Nov 03 13:13:27 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:27 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_5mbwm27l" returned: 0 in 0.395s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_5mbwm27l {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:27 devstack sudo[96519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_5mbwm27l Nov 03 13:13:27 devstack sudo[96519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:28 devstack sudo[96519]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_5mbwm27l" returned: 1 in 0.488s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_5mbwm27l' failed. Not Retrying. {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:13:28 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbac699-281c-4a04-9386-271fcaf742c3]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_2ptspn7ldevstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:28 devstack sudo[96523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_2ptspn7ldevstack@QuobyteHD Nov 03 13:13:28 devstack sudo[96523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:28 devstack sudo[96523]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_2ptspn7ldevstack@QuobyteHD" returned: 0 in 0.508s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:28 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] d23bcc2f-7dfc-45dc-b259-aec67f909b4f was qcow2, converting to qcow2 {{(pid=86725) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 13:13:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_2ptspn7ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cda8185a-9c06-43ab-97eb-da0c3aa52a30 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:28 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_2ptspn7ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cda8185a-9c06-43ab-97eb-da0c3aa52a30 Nov 03 13:13:28 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:31 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_2ptspn7ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cda8185a-9c06-43ab-97eb-da0c3aa52a30" returned: 0 in 2.410s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:31 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_2ptspn7ldevstack@QuobyteHD, size 112.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cda8185a-9c06-43ab-97eb-da0c3aa52a30 {{(pid=86725) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:13:31 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Converted 112.00 MB image at 46.44 MB/s Nov 03 13:13:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cda8185a-9c06-43ab-97eb-da0c3aa52a30 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:31 devstack sudo[96537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cda8185a-9c06-43ab-97eb-da0c3aa52a30 1G Nov 03 13:13:31 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:31 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cda8185a-9c06-43ab-97eb-da0c3aa52a30 1G" returned: 0 in 0.400s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:31 devstack cinder-volume[86725]: DEBUG cinder.volume.volume_utils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Downloaded image d23bcc2f-7dfc-45dc-b259-aec67f909b4f ((None, [{'url': 'file:///opt/stack/data/glance/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'metadata': {}}])) to volume cda8185a-9c06-43ab-97eb-da0c3aa52a30 successfully. {{(pid=86725) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 13:13:31 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Temporary image d23bcc2f-7dfc-45dc-b259-aec67f909b4f for user fd4dfb10072d401385a629c2ba422dd3 is deleted. {{(pid=86725) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 13:13:31 devstack cinder-volume[86725]: DEBUG cinder.volume.volume_utils [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Marking volume cda8185a-9c06-43ab-97eb-da0c3aa52a30 as bootable. {{(pid=86725) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 13:13:31 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Copying metadata from image d23bcc2f-7dfc-45dc-b259-aec67f909b4f to cda8185a-9c06-43ab-97eb-da0c3aa52a30. {{(pid=86725) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 13:13:31 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Creating volume glance metadata for volume cda8185a-9c06-43ab-97eb-da0c3aa52a30 backed by image d23bcc2f-7dfc-45dc-b259-aec67f909b4f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86725) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 13:13:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924866e0-9ef6-4e8c-a110-089c48e2ba96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cda8185a-9c06-43ab-97eb-da0c3aa52a30', 'volume_size': 1, 'image_id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8a9fdfe427f436894d9c81085f9b6d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'created_at': datetime.datetime(2026, 11, 3, 12, 0, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 0, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bdcac83-a92f-4e76-8f71-422ec8f995e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:31 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Volume volume-cda8185a-9c06-43ab-97eb-da0c3aa52a30 (cda8185a-9c06-43ab-97eb-da0c3aa52a30): created successfully Nov 03 13:13:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bdcac83-a92f-4e76-8f71-422ec8f995e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Flow 'volume_create_manager' (4431a04a-ff75-4101-a705-898d5f723dca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:31 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-40917a66-1abc-4dd0-b1ce-1f8f6769ecfd tempest-VolumesGetTest-2074296944 None] Created volume successfully. Nov 03 13:13:33 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:13:33 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] Flow 'volume_create_manager' (81a18b8e-fd22-4764-b8c0-ebbfc3bcaad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:33 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6907ec-10cc-4bfe-8d05-d5875ed570ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:33 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6907ec-10cc-4bfe-8d05-d5875ed570ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1652491832',display_name='tempest-VolumesGetTest-Volume-994493068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a9fe9c7-3144-4b97-8da9-5f391fe37386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9522a11a75cf44bc84765823c173de83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:33Z,use_quota=True,user_id='fd4dfb10072d401385a629c2ba422dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:33 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a60c91-993c-4e31-b186-64bd26b947d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:33 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a60c91-993c-4e31-b186-64bd26b947d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:33 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (922b4987-ff4e-4108-b174-624d5aed5496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:33 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (922b4987-ff4e-4108-b174-624d5aed5496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a9fe9c7-3144-4b97-8da9-5f391fe37386', 'volume_name': 'volume-2a9fe9c7-3144-4b97-8da9-5f391fe37386', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:33 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38b7a7d0-247f-47db-bd5e-409617fc42aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:33 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38b7a7d0-247f-47db-bd5e-409617fc42aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:33 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8001c7de-f030-4783-aae8-6c870393ba2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:33 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] Volume 2a9fe9c7-3144-4b97-8da9-5f391fe37386: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a9fe9c7-3144-4b97-8da9-5f391fe37386', 'volume_size': 1} Nov 03 13:13:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:33 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1652491832',display_name='tempest-VolumesGetTest-Volume-994493068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a9fe9c7-3144-4b97-8da9-5f391fe37386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9522a11a75cf44bc84765823c173de83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:33Z,use_quota=True,user_id='fd4dfb10072d401385a629c2ba422dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:13:33 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] Creating volume 2a9fe9c7-3144-4b97-8da9-5f391fe37386 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:13:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:33 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:33 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:33 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:13:33 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:13:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2a9fe9c7-3144-4b97-8da9-5f391fe37386 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:33 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2a9fe9c7-3144-4b97-8da9-5f391fe37386 1073741824 Nov 03 13:13:33 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:34 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2a9fe9c7-3144-4b97-8da9-5f391fe37386 1073741824" returned: 0 in 0.626s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2a9fe9c7-3144-4b97-8da9-5f391fe37386 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:34 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2a9fe9c7-3144-4b97-8da9-5f391fe37386 Nov 03 13:13:34 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:34 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-8e696073-a1a3-4b0d-8ff0-64a53e884404 tempest-GroupSnapshotsTest-1856318917 None] Group tempest-GroupSnapshotsTest-Group-1559954214: creating Nov 03 13:13:34 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-8e696073-a1a3-4b0d-8ff0-64a53e884404 tempest-GroupSnapshotsTest-1856318917 None] Group tempest-GroupSnapshotsTest-Group-1559954214: created successfully Nov 03 13:13:34 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-8e696073-a1a3-4b0d-8ff0-64a53e884404 tempest-GroupSnapshotsTest-1856318917 None] Create group completed successfully. Nov 03 13:13:34 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2a9fe9c7-3144-4b97-8da9-5f391fe37386" returned: 0 in 0.371s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:34 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:13:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8001c7de-f030-4783-aae8-6c870393ba2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a9fe9c7-3144-4b97-8da9-5f391fe37386', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d87095b4-bf3f-45bf-9560-e46732719477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:34 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] Volume volume-2a9fe9c7-3144-4b97-8da9-5f391fe37386 (2a9fe9c7-3144-4b97-8da9-5f391fe37386): created successfully Nov 03 13:13:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d87095b4-bf3f-45bf-9560-e46732719477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] Flow 'volume_create_manager' (81a18b8e-fd22-4764-b8c0-ebbfc3bcaad6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:34 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-616f8d1c-1a23-4f95-bdd9-43ed18e2d083 tempest-VolumesGetTest-2074296944 None] Created volume successfully. Nov 03 13:13:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-13c38ac8-532f-47be-b9ff-bfeb778ff615 tempest-VolumesGetTest-2074296944 None] Acquiring lock "cinder-2a9fe9c7-3144-4b97-8da9-5f391fe37386-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-13c38ac8-532f-47be-b9ff-bfeb778ff615 tempest-VolumesGetTest-2074296944 None] Lock "cinder-2a9fe9c7-3144-4b97-8da9-5f391fe37386-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-13c38ac8-532f-47be-b9ff-bfeb778ff615 tempest-VolumesGetTest-2074296944 None] Acquiring lock "cinder-quobyte-2a9fe9c7-3144-4b97-8da9-5f391fe37386" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-13c38ac8-532f-47be-b9ff-bfeb778ff615 tempest-VolumesGetTest-2074296944 None] Lock "cinder-quobyte-2a9fe9c7-3144-4b97-8da9-5f391fe37386" acquired by "delete_volume" :: waited 0.023s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:35 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e42edf-82a5-45c6-bb5f-12cd502423a1]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-13c38ac8-532f-47be-b9ff-bfeb778ff615 tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2a9fe9c7-3144-4b97-8da9-5f391fe37386 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:35 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2a9fe9c7-3144-4b97-8da9-5f391fe37386 Nov 03 13:13:35 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] Flow 'volume_create_manager' (4498ce52-0af9-42ea-92c2-f52df9937693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (458c180d-1c3b-4db9-873e-4d35303bd23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (458c180d-1c3b-4db9-873e-4d35303bd23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-991175250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=09e80a7e-fe19-4030-9aff-f69c47dfd720,host='devstack@QuobyteHD#QuobyteHD',id=986b9d45-9926-4833-bd5c-95f65df42859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64ad2c04c3064b0cb6e157c387cb14e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:36Z,use_quota=True,user_id='5dcd966f7a8541568b9f73e8f8174231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd6a2b3c-3321-4421-9878-c07beec17456),volume_type_id=bd6a2b3c-3321-4421-9878-c07beec17456)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a2cb401-fdf5-4c8d-8972-adeeb3d3c067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a2cb401-fdf5-4c8d-8972-adeeb3d3c067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a28d068-cf70-422a-ae83-97bbf70490c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a28d068-cf70-422a-ae83-97bbf70490c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '986b9d45-9926-4833-bd5c-95f65df42859', 'volume_name': 'volume-986b9d45-9926-4833-bd5c-95f65df42859', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94f482f0-0d5e-4e7c-a387-b58c67daec40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94f482f0-0d5e-4e7c-a387-b58c67daec40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452f436e-f85a-43fb-89fb-b6518bfc527c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:36 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] Volume 986b9d45-9926-4833-bd5c-95f65df42859: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-986b9d45-9926-4833-bd5c-95f65df42859', 'volume_size': 1} Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=09e80a7e-fe19-4030-9aff-f69c47dfd720,created_at=2026-11-03T12:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-991175250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=09e80a7e-fe19-4030-9aff-f69c47dfd720,host='devstack@QuobyteHD#QuobyteHD',id=986b9d45-9926-4833-bd5c-95f65df42859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64ad2c04c3064b0cb6e157c387cb14e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:36Z,use_quota=True,user_id='5dcd966f7a8541568b9f73e8f8174231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd6a2b3c-3321-4421-9878-c07beec17456),volume_type_id=bd6a2b3c-3321-4421-9878-c07beec17456)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] Creating volume 986b9d45-9926-4833-bd5c-95f65df42859 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:36 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:13:36 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-13c38ac8-532f-47be-b9ff-bfeb778ff615 tempest-VolumesGetTest-2074296944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2a9fe9c7-3144-4b97-8da9-5f391fe37386" returned: 0 in 0.481s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-13c38ac8-532f-47be-b9ff-bfeb778ff615 tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2a9fe9c7-3144-4b97-8da9-5f391fe37386 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:36 devstack sudo[96599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859 1073741824 Nov 03 13:13:36 devstack sudo[96599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:36 devstack sudo[96600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2a9fe9c7-3144-4b97-8da9-5f391fe37386 Nov 03 13:13:36 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:36 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-13c38ac8-532f-47be-b9ff-bfeb778ff615 tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2a9fe9c7-3144-4b97-8da9-5f391fe37386" returned: 0 in 0.266s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-13c38ac8-532f-47be-b9ff-bfeb778ff615 tempest-VolumesGetTest-2074296944 None] Lock "cinder-quobyte-2a9fe9c7-3144-4b97-8da9-5f391fe37386" released by "delete_volume" :: held 0.804s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-13c38ac8-532f-47be-b9ff-bfeb778ff615 tempest-VolumesGetTest-2074296944 None] Created reservations ['06651d27-5dc3-4fb8-9b62-35a3e6350ac3', '20b96234-19c5-4774-887e-0a328fae0714', 'bebdb5ad-a312-4c06-ae86-ce8d0aa3445f', 'a76b39d2-1d5c-4a6e-9d37-76118416275e'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-13c38ac8-532f-47be-b9ff-bfeb778ff615 tempest-VolumesGetTest-2074296944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-13c38ac8-532f-47be-b9ff-bfeb778ff615 tempest-VolumesGetTest-2074296944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-13c38ac8-532f-47be-b9ff-bfeb778ff615 tempest-VolumesGetTest-2074296944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-13c38ac8-532f-47be-b9ff-bfeb778ff615 tempest-VolumesGetTest-2074296944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-13c38ac8-532f-47be-b9ff-bfeb778ff615 tempest-VolumesGetTest-2074296944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-13c38ac8-532f-47be-b9ff-bfeb778ff615 tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:36 devstack sudo[96608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:13:36 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:36 devstack sudo[96599]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859 1073741824" returned: 0 in 0.594s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:36 devstack sudo[96610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859 Nov 03 13:13:36 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-95c2552e-d13d-4d69-8d74-007ccf66a308 tempest-VolumesGetTest-2074296944 None] Acquiring lock "cinder-cda8185a-9c06-43ab-97eb-da0c3aa52a30-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:36 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:37 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-95c2552e-d13d-4d69-8d74-007ccf66a308 tempest-VolumesGetTest-2074296944 None] Lock "cinder-cda8185a-9c06-43ab-97eb-da0c3aa52a30-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:37 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-95c2552e-d13d-4d69-8d74-007ccf66a308 tempest-VolumesGetTest-2074296944 None] Acquiring lock "cinder-quobyte-cda8185a-9c06-43ab-97eb-da0c3aa52a30" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:37 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-95c2552e-d13d-4d69-8d74-007ccf66a308 tempest-VolumesGetTest-2074296944 None] Lock "cinder-quobyte-cda8185a-9c06-43ab-97eb-da0c3aa52a30" acquired by "delete_volume" :: waited 0.028s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:37 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-13c38ac8-532f-47be-b9ff-bfeb778ff615 tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.352s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:37 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-13c38ac8-532f-47be-b9ff-bfeb778ff615 tempest-VolumesGetTest-2074296944 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:37 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-13c38ac8-532f-47be-b9ff-bfeb778ff615 tempest-VolumesGetTest-2074296944 None] Deleted volume successfully. Nov 03 13:13:37 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b11390-aa63-41cf-bf54-5a1876701863]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-95c2552e-d13d-4d69-8d74-007ccf66a308 tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cda8185a-9c06-43ab-97eb-da0c3aa52a30 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:37 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-13c38ac8-532f-47be-b9ff-bfeb778ff615 tempest-VolumesGetTest-2074296944 None] Lock "cinder-2a9fe9c7-3144-4b97-8da9-5f391fe37386-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:37 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859" returned: 0 in 0.322s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:37 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:13:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:37 devstack sudo[96613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cda8185a-9c06-43ab-97eb-da0c3aa52a30 Nov 03 13:13:37 devstack sudo[96613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452f436e-f85a-43fb-89fb-b6518bfc527c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-986b9d45-9926-4833-bd5c-95f65df42859', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a715a8f-5d16-412d-b79a-cb24ecedbe7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:37 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] Volume volume-986b9d45-9926-4833-bd5c-95f65df42859 (986b9d45-9926-4833-bd5c-95f65df42859): created successfully Nov 03 13:13:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a715a8f-5d16-412d-b79a-cb24ecedbe7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] Flow 'volume_create_manager' (4498ce52-0af9-42ea-92c2-f52df9937693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:37 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-449a59f4-b244-4147-95ba-b37f8cc31f2b tempest-GroupSnapshotsTest-1856318917 None] Created volume successfully. Nov 03 13:13:37 devstack sudo[96613]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-95c2552e-d13d-4d69-8d74-007ccf66a308 tempest-VolumesGetTest-2074296944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cda8185a-9c06-43ab-97eb-da0c3aa52a30" returned: 0 in 0.411s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-95c2552e-d13d-4d69-8d74-007ccf66a308 tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cda8185a-9c06-43ab-97eb-da0c3aa52a30 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:37 devstack sudo[96619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cda8185a-9c06-43ab-97eb-da0c3aa52a30 Nov 03 13:13:37 devstack sudo[96619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:37 devstack sudo[96619]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-95c2552e-d13d-4d69-8d74-007ccf66a308 tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cda8185a-9c06-43ab-97eb-da0c3aa52a30" returned: 0 in 0.262s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:37 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-95c2552e-d13d-4d69-8d74-007ccf66a308 tempest-VolumesGetTest-2074296944 None] Lock "cinder-quobyte-cda8185a-9c06-43ab-97eb-da0c3aa52a30" released by "delete_volume" :: held 0.747s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:37 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-95c2552e-d13d-4d69-8d74-007ccf66a308 tempest-VolumesGetTest-2074296944 None] Created reservations ['bbfd4f7d-8ef8-40f9-9df7-e685c11e7c8f', 'aef0a125-9b1f-4433-88da-c86f1a193219', '756fa9a8-d36a-41d4-9a37-abae0e774842', '2c89a9e9-bd00-4ef6-9a87-f7cf9148292f'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-95c2552e-d13d-4d69-8d74-007ccf66a308 tempest-VolumesGetTest-2074296944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-95c2552e-d13d-4d69-8d74-007ccf66a308 tempest-VolumesGetTest-2074296944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:37 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-95c2552e-d13d-4d69-8d74-007ccf66a308 tempest-VolumesGetTest-2074296944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:37 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-95c2552e-d13d-4d69-8d74-007ccf66a308 tempest-VolumesGetTest-2074296944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-95c2552e-d13d-4d69-8d74-007ccf66a308 tempest-VolumesGetTest-2074296944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-95c2552e-d13d-4d69-8d74-007ccf66a308 tempest-VolumesGetTest-2074296944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:37 devstack sudo[96622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:13:37 devstack sudo[96622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:38 devstack sudo[96622]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-95c2552e-d13d-4d69-8d74-007ccf66a308 tempest-VolumesGetTest-2074296944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.262s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:38 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-95c2552e-d13d-4d69-8d74-007ccf66a308 tempest-VolumesGetTest-2074296944 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:38 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-95c2552e-d13d-4d69-8d74-007ccf66a308 tempest-VolumesGetTest-2074296944 None] Deleted volume successfully. Nov 03 13:13:38 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-95c2552e-d13d-4d69-8d74-007ccf66a308 tempest-VolumesGetTest-2074296944 None] Lock "cinder-cda8185a-9c06-43ab-97eb-da0c3aa52a30-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:38 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-9af2c782-a81f-4ff8-9929-746d8da6771f tempest-GroupSnapshotsTest-1856318917 None] GroupSnapshot 0ffa779a-71f4-41c5-8518-4c4dfef3966b: creating. Nov 03 13:13:38 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9af2c782-a81f-4ff8-9929-746d8da6771f tempest-GroupSnapshotsTest-1856318917 None] Group snapshot 0ffa779a-71f4-41c5-8518-4c4dfef3966b: creating. {{(pid=86725) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 13:13:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9af2c782-a81f-4ff8-9929-746d8da6771f tempest-GroupSnapshotsTest-1856318917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9af2c782-a81f-4ff8-9929-746d8da6771f tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:38 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-9af2c782-a81f-4ff8-9929-746d8da6771f tempest-GroupSnapshotsTest-1856318917 None] Creating offline snapshot 1932c8b0-9334-4884-be84-c773cd827305 of volume 986b9d45-9926-4833-bd5c-95f65df42859 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:13:38 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[763dd49b-f884-4e50-8fb2-279c2246a5af]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9af2c782-a81f-4ff8-9929-746d8da6771f tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:39 devstack sudo[96625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859 Nov 03 13:13:39 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:39 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9af2c782-a81f-4ff8-9929-746d8da6771f tempest-GroupSnapshotsTest-1856318917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859" returned: 0 in 0.430s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9af2c782-a81f-4ff8-9929-746d8da6771f tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859.1932c8b0-9334-4884-be84-c773cd827305 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:39 devstack sudo[96630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859.1932c8b0-9334-4884-be84-c773cd827305 1G Nov 03 13:13:39 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:39 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9af2c782-a81f-4ff8-9929-746d8da6771f tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859.1932c8b0-9334-4884-be84-c773cd827305 1G" returned: 0 in 0.511s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9af2c782-a81f-4ff8-9929-746d8da6771f tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-986b9d45-9926-4833-bd5c-95f65df42859 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859.1932c8b0-9334-4884-be84-c773cd827305 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:39 devstack sudo[96636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-986b9d45-9926-4833-bd5c-95f65df42859 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859.1932c8b0-9334-4884-be84-c773cd827305 Nov 03 13:13:39 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:40 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9af2c782-a81f-4ff8-9929-746d8da6771f tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-986b9d45-9926-4833-bd5c-95f65df42859 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859.1932c8b0-9334-4884-be84-c773cd827305" returned: 0 in 0.341s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:40 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-9af2c782-a81f-4ff8-9929-746d8da6771f tempest-GroupSnapshotsTest-1856318917 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859.1932c8b0-9334-4884-be84-c773cd827305 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 13:13:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9af2c782-a81f-4ff8-9929-746d8da6771f tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859.1932c8b0-9334-4884-be84-c773cd827305 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:40 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859.1932c8b0-9334-4884-be84-c773cd827305 Nov 03 13:13:40 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:40 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9af2c782-a81f-4ff8-9929-746d8da6771f tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859.1932c8b0-9334-4884-be84-c773cd827305" returned: 0 in 0.286s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9af2c782-a81f-4ff8-9929-746d8da6771f tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:40 devstack sudo[96644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859.info Nov 03 13:13:40 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:40 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9af2c782-a81f-4ff8-9929-746d8da6771f tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859.info" returned: 0 in 0.283s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:40 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-9af2c782-a81f-4ff8-9929-746d8da6771f tempest-GroupSnapshotsTest-1856318917 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 13:13:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9af2c782-a81f-4ff8-9929-746d8da6771f tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:40 devstack sudo[96647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859.info Nov 03 13:13:40 devstack sudo[96647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:41 devstack sudo[96647]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9af2c782-a81f-4ff8-9929-746d8da6771f tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859.info" returned: 0 in 0.335s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9af2c782-a81f-4ff8-9929-746d8da6771f tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.291s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:41 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-9af2c782-a81f-4ff8-9929-746d8da6771f tempest-GroupSnapshotsTest-1856318917 None] group_snapshot 0ffa779a-71f4-41c5-8518-4c4dfef3966b: created successfully Nov 03 13:13:43 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:13:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] Flow 'volume_create_manager' (0c80eb36-7137-420f-86a6-7b0320e8ff70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e6676a0-e545-4935-9316-bd6ad425d9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e6676a0-e545-4935-9316-bd6ad425d9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1465904405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64e043d2-3115-4146-b365-cc5e5ae71688,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d4e5b56190bf4ff0bbd5133ab08fe645',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:43Z,use_quota=True,user_id='88fd6523a52d431f8048953431af807e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abeddeac-aebc-485e-a037-9e424ae2306e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abeddeac-aebc-485e-a037-9e424ae2306e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5856b3f6-b981-457d-a20f-0ea7c4d5dd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5856b3f6-b981-457d-a20f-0ea7c4d5dd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64e043d2-3115-4146-b365-cc5e5ae71688', 'volume_name': 'volume-64e043d2-3115-4146-b365-cc5e5ae71688', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c440405-1266-4ae2-8982-9f8f90451e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c440405-1266-4ae2-8982-9f8f90451e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2b20c22-3c1d-4d27-9cae-0f627d337fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:43 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] Volume 64e043d2-3115-4146-b365-cc5e5ae71688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64e043d2-3115-4146-b365-cc5e5ae71688', 'volume_size': 1} Nov 03 13:13:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:43 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1465904405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64e043d2-3115-4146-b365-cc5e5ae71688,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d4e5b56190bf4ff0bbd5133ab08fe645',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:43Z,use_quota=True,user_id='88fd6523a52d431f8048953431af807e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:13:43 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] Creating volume 64e043d2-3115-4146-b365-cc5e5ae71688 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:13:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:43 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:43 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:43 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:13:43 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:13:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-64e043d2-3115-4146-b365-cc5e5ae71688 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:43 devstack sudo[96650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-64e043d2-3115-4146-b365-cc5e5ae71688 1073741824 Nov 03 13:13:43 devstack sudo[96650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:43 devstack sudo[96650]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-64e043d2-3115-4146-b365-cc5e5ae71688 1073741824" returned: 0 in 0.644s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-64e043d2-3115-4146-b365-cc5e5ae71688 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:44 devstack sudo[96696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-64e043d2-3115-4146-b365-cc5e5ae71688 Nov 03 13:13:44 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:44 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-64e043d2-3115-4146-b365-cc5e5ae71688" returned: 0 in 0.317s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:13:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.921s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:44 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] Acquiring lock "cinder-quobyte-1932c8b0-9334-4884-be84-c773cd827305-71309e0f-ae4e-4070-8904-6b2fc7b0051b" by "_create_volume_from_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2b20c22-3c1d-4d27-9cae-0f627d337fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64e043d2-3115-4146-b365-cc5e5ae71688', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4746ba9-4985-415b-8b2a-30dcd3986f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:44 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] Lock "cinder-quobyte-1932c8b0-9334-4884-be84-c773cd827305-71309e0f-ae4e-4070-8904-6b2fc7b0051b" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] Creating volume 71309e0f-ae4e-4070-8904-6b2fc7b0051b from snapshot 1932c8b0-9334-4884-be84-c773cd827305 {{(pid=86725) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 13:13:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:13:44 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] Acquiring lock "cinder-quobyte-71309e0f-ae4e-4070-8904-6b2fc7b0051b" by "_copy_volume_from_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:44 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] Volume volume-64e043d2-3115-4146-b365-cc5e5ae71688 (64e043d2-3115-4146-b365-cc5e5ae71688): created successfully Nov 03 13:13:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4746ba9-4985-415b-8b2a-30dcd3986f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] Flow 'volume_create_manager' (0c80eb36-7137-420f-86a6-7b0320e8ff70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:44 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] Lock "cinder-quobyte-71309e0f-ae4e-4070-8904-6b2fc7b0051b" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] snapshot: 1932c8b0-9334-4884-be84-c773cd827305, volume: 71309e0f-ae4e-4070-8904-6b2fc7b0051b, {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 13:13:44 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-9ee8a70d-56b1-49fd-bd67-05faa7bf9f55 tempest-VolumesListTestJSON-566154618 None] Created volume successfully. Nov 03 13:13:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:44 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a56069-3c51-4d47-8fb2-ee055e2138ba]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859.1932c8b0-9334-4884-be84-c773cd827305 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:44 devstack sudo[96701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859.1932c8b0-9334-4884-be84-c773cd827305 Nov 03 13:13:44 devstack sudo[96701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:44 devstack sudo[96701]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859.1932c8b0-9334-4884-be84-c773cd827305" returned: 0 in 0.508s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-986b9d45-9926-4833-bd5c-95f65df42859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:13:44 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dbd768-43e0-4a05-ad99-59d3799babca]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:45 devstack sudo[96707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859 Nov 03 13:13:45 devstack sudo[96707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:45 devstack sudo[96707]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859" returned: 0 in 0.607s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:45 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859 {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 13:13:45 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] Creating direct copy from snapshot {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 13:13:45 devstack cinder-volume[86725]: DEBUG cinder.utils [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] Path /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71309e0f-ae4e-4070-8904-6b2fc7b0051b not found in is_blk_device check {{(pid=86725) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 13:13:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71309e0f-ae4e-4070-8904-6b2fc7b0051b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:45 devstack sudo[96729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71309e0f-ae4e-4070-8904-6b2fc7b0051b Nov 03 13:13:45 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:46 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:13:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] Flow 'volume_create_manager' (b6936915-90e3-49de-b8a0-9d016678b58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2fd6664-3eb4-40a9-b9e3-03aac6555d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2fd6664-3eb4-40a9-b9e3-03aac6555d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2101090416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a9cb70-3878-4d6e-8ee2-9bbaf18882ae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d4e5b56190bf4ff0bbd5133ab08fe645',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:46Z,use_quota=True,user_id='88fd6523a52d431f8048953431af807e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d12091bf-e60b-4bb2-933a-9c86112a4ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d12091bf-e60b-4bb2-933a-9c86112a4ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b97a336-2da3-42d2-96c3-76c06cbc57f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b97a336-2da3-42d2-96c3-76c06cbc57f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51a9cb70-3878-4d6e-8ee2-9bbaf18882ae', 'volume_name': 'volume-51a9cb70-3878-4d6e-8ee2-9bbaf18882ae', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd082f46-a0d1-4f99-b0e9-bc20d410c324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd082f46-a0d1-4f99-b0e9-bc20d410c324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49ae6eb4-12c9-4070-ae47-47639ba98565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:46 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] Volume 51a9cb70-3878-4d6e-8ee2-9bbaf18882ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51a9cb70-3878-4d6e-8ee2-9bbaf18882ae', 'volume_size': 1} Nov 03 13:13:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:49 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-0a9666ae-2f34-4ad8-8ef5-660052f69d77 req-1530ff7d-293a-4dff-8788-75f3898492db tempest-ServerActionsTestOtherA-2024956670 None] Terminate volume connection completed successfully. Nov 03 13:13:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-0a9666ae-2f34-4ad8-8ef5-660052f69d77 req-1530ff7d-293a-4dff-8788-75f3898492db tempest-ServerActionsTestOtherA-2024956670 None] Deleting attachment 81f6ce00-1650-4dc6-bc22-95b6f42e351a. {{(pid=86725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:13:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [req-0a9666ae-2f34-4ad8-8ef5-660052f69d77 req-47d242f4-4d0b-4df6-9375-06d20b762fd1 tempest-ServerActionsTestOtherA-2024956670 None] Acquiring lock "cinder-4ef6494c-6050-43f3-a045-8482e64733b0-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [req-0a9666ae-2f34-4ad8-8ef5-660052f69d77 req-47d242f4-4d0b-4df6-9375-06d20b762fd1 tempest-ServerActionsTestOtherA-2024956670 None] Lock "cinder-4ef6494c-6050-43f3-a045-8482e64733b0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [req-0a9666ae-2f34-4ad8-8ef5-660052f69d77 req-47d242f4-4d0b-4df6-9375-06d20b762fd1 tempest-ServerActionsTestOtherA-2024956670 None] Acquiring lock "cinder-quobyte-4ef6494c-6050-43f3-a045-8482e64733b0" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [req-0a9666ae-2f34-4ad8-8ef5-660052f69d77 req-47d242f4-4d0b-4df6-9375-06d20b762fd1 tempest-ServerActionsTestOtherA-2024956670 None] Lock "cinder-quobyte-4ef6494c-6050-43f3-a045-8482e64733b0" acquired by "delete_volume" :: waited 0.029s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:50 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c59902-2d06-4147-b68e-568bd6929847]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-0a9666ae-2f34-4ad8-8ef5-660052f69d77 req-47d242f4-4d0b-4df6-9375-06d20b762fd1 tempest-ServerActionsTestOtherA-2024956670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4ef6494c-6050-43f3-a045-8482e64733b0 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:50 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4ef6494c-6050-43f3-a045-8482e64733b0 Nov 03 13:13:50 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:51 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-0a9666ae-2f34-4ad8-8ef5-660052f69d77 req-47d242f4-4d0b-4df6-9375-06d20b762fd1 tempest-ServerActionsTestOtherA-2024956670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4ef6494c-6050-43f3-a045-8482e64733b0" returned: 0 in 0.751s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-0a9666ae-2f34-4ad8-8ef5-660052f69d77 req-47d242f4-4d0b-4df6-9375-06d20b762fd1 tempest-ServerActionsTestOtherA-2024956670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4ef6494c-6050-43f3-a045-8482e64733b0 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:51 devstack sudo[96758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4ef6494c-6050-43f3-a045-8482e64733b0 Nov 03 13:13:51 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:51 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-0a9666ae-2f34-4ad8-8ef5-660052f69d77 req-47d242f4-4d0b-4df6-9375-06d20b762fd1 tempest-ServerActionsTestOtherA-2024956670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4ef6494c-6050-43f3-a045-8482e64733b0" returned: 0 in 0.597s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [req-0a9666ae-2f34-4ad8-8ef5-660052f69d77 req-47d242f4-4d0b-4df6-9375-06d20b762fd1 tempest-ServerActionsTestOtherA-2024956670 None] Lock "cinder-quobyte-4ef6494c-6050-43f3-a045-8482e64733b0" released by "delete_volume" :: held 1.456s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:51 devstack cinder-volume[86725]: DEBUG cinder.quota [req-0a9666ae-2f34-4ad8-8ef5-660052f69d77 req-47d242f4-4d0b-4df6-9375-06d20b762fd1 tempest-ServerActionsTestOtherA-2024956670 None] Created reservations ['52742484-4c93-4f75-a260-d80b4379621c', '9f97b2ed-36fc-48c1-819e-6bdc6e9d24e9', '72cd87c4-5e64-4aed-83b8-980e3c65ca7d', '332da568-383e-44ea-8b69-689dcc1ad1a5'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-0a9666ae-2f34-4ad8-8ef5-660052f69d77 req-47d242f4-4d0b-4df6-9375-06d20b762fd1 tempest-ServerActionsTestOtherA-2024956670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-0a9666ae-2f34-4ad8-8ef5-660052f69d77 req-47d242f4-4d0b-4df6-9375-06d20b762fd1 tempest-ServerActionsTestOtherA-2024956670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [req-0a9666ae-2f34-4ad8-8ef5-660052f69d77 req-47d242f4-4d0b-4df6-9375-06d20b762fd1 tempest-ServerActionsTestOtherA-2024956670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [req-0a9666ae-2f34-4ad8-8ef5-660052f69d77 req-47d242f4-4d0b-4df6-9375-06d20b762fd1 tempest-ServerActionsTestOtherA-2024956670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-0a9666ae-2f34-4ad8-8ef5-660052f69d77 req-47d242f4-4d0b-4df6-9375-06d20b762fd1 tempest-ServerActionsTestOtherA-2024956670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-0a9666ae-2f34-4ad8-8ef5-660052f69d77 req-47d242f4-4d0b-4df6-9375-06d20b762fd1 tempest-ServerActionsTestOtherA-2024956670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:52 devstack sudo[96761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:13:52 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:52 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-0a9666ae-2f34-4ad8-8ef5-660052f69d77 req-47d242f4-4d0b-4df6-9375-06d20b762fd1 tempest-ServerActionsTestOtherA-2024956670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.462s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:52 devstack cinder-volume[86725]: DEBUG cinder.manager [req-0a9666ae-2f34-4ad8-8ef5-660052f69d77 req-47d242f4-4d0b-4df6-9375-06d20b762fd1 tempest-ServerActionsTestOtherA-2024956670 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:52 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-0a9666ae-2f34-4ad8-8ef5-660052f69d77 req-47d242f4-4d0b-4df6-9375-06d20b762fd1 tempest-ServerActionsTestOtherA-2024956670 None] Deleted volume successfully. Nov 03 13:13:52 devstack cinder-volume[86725]: DEBUG cinder.coordination [req-0a9666ae-2f34-4ad8-8ef5-660052f69d77 req-47d242f4-4d0b-4df6-9375-06d20b762fd1 tempest-ServerActionsTestOtherA-2024956670 None] Lock "cinder-4ef6494c-6050-43f3-a045-8482e64733b0-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:52 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-7ebb6c29-b9c3-454e-ac8b-11d2558876cd tempest-ServerActionsTestOtherA-2024956670 None] Acquiring lock "cinder-cfbaad03-ad94-4aa4-9908-bed601c27244-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:52 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-7ebb6c29-b9c3-454e-ac8b-11d2558876cd tempest-ServerActionsTestOtherA-2024956670 None] Lock "cinder-cfbaad03-ad94-4aa4-9908-bed601c27244-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:52 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-7ebb6c29-b9c3-454e-ac8b-11d2558876cd tempest-ServerActionsTestOtherA-2024956670 None] Acquiring lock "cinder-quobyte-cfbaad03-ad94-4aa4-9908-bed601c27244" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:52 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-7ebb6c29-b9c3-454e-ac8b-11d2558876cd tempest-ServerActionsTestOtherA-2024956670 None] Lock "cinder-quobyte-cfbaad03-ad94-4aa4-9908-bed601c27244" acquired by "delete_volume" :: waited 0.045s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:52 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83a0348-d7bb-4937-8c6a-f08dd4847a15]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7ebb6c29-b9c3-454e-ac8b-11d2558876cd tempest-ServerActionsTestOtherA-2024956670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cfbaad03-ad94-4aa4-9908-bed601c27244 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:53 devstack sudo[96764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cfbaad03-ad94-4aa4-9908-bed601c27244 Nov 03 13:13:53 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:53 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7ebb6c29-b9c3-454e-ac8b-11d2558876cd tempest-ServerActionsTestOtherA-2024956670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cfbaad03-ad94-4aa4-9908-bed601c27244" returned: 0 in 0.613s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7ebb6c29-b9c3-454e-ac8b-11d2558876cd tempest-ServerActionsTestOtherA-2024956670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cfbaad03-ad94-4aa4-9908-bed601c27244 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:53 devstack sudo[96770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cfbaad03-ad94-4aa4-9908-bed601c27244 Nov 03 13:13:53 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:54 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7ebb6c29-b9c3-454e-ac8b-11d2558876cd tempest-ServerActionsTestOtherA-2024956670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cfbaad03-ad94-4aa4-9908-bed601c27244" returned: 0 in 0.484s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:54 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-7ebb6c29-b9c3-454e-ac8b-11d2558876cd tempest-ServerActionsTestOtherA-2024956670 None] Lock "cinder-quobyte-cfbaad03-ad94-4aa4-9908-bed601c27244" released by "delete_volume" :: held 1.216s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:54 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-7ebb6c29-b9c3-454e-ac8b-11d2558876cd tempest-ServerActionsTestOtherA-2024956670 None] Created reservations ['dab1e38d-1462-4ed3-ae0d-c160cf8f1d05', '593b61c4-f0f5-4c2b-a623-7bb3ceda6f2e', 'bdc0f6ce-7eec-4d55-a1e2-c92df5ae20cb', '3c66a060-2e35-48af-aef5-2f94e65dd8ca'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7ebb6c29-b9c3-454e-ac8b-11d2558876cd tempest-ServerActionsTestOtherA-2024956670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7ebb6c29-b9c3-454e-ac8b-11d2558876cd tempest-ServerActionsTestOtherA-2024956670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:54 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7ebb6c29-b9c3-454e-ac8b-11d2558876cd tempest-ServerActionsTestOtherA-2024956670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:54 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7ebb6c29-b9c3-454e-ac8b-11d2558876cd tempest-ServerActionsTestOtherA-2024956670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7ebb6c29-b9c3-454e-ac8b-11d2558876cd tempest-ServerActionsTestOtherA-2024956670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7ebb6c29-b9c3-454e-ac8b-11d2558876cd tempest-ServerActionsTestOtherA-2024956670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:54 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:13:54 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:54 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71309e0f-ae4e-4070-8904-6b2fc7b0051b" returned: 0 in 9.236s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:54 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859, size 1024.00 MB, duration 9.24 sec, destination /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71309e0f-ae4e-4070-8904-6b2fc7b0051b {{(pid=86725) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:13:54 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] Converted 1024.00 MB image at 110.85 MB/s Nov 03 13:13:54 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71309e0f-ae4e-4070-8904-6b2fc7b0051b is being set with open permissions: ugo+rw: NotImplementedError Nov 03 13:13:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71309e0f-ae4e-4070-8904-6b2fc7b0051b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:54 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:54 devstack sudo[96776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71309e0f-ae4e-4070-8904-6b2fc7b0051b Nov 03 13:13:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7ebb6c29-b9c3-454e-ac8b-11d2558876cd tempest-ServerActionsTestOtherA-2024956670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.457s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:54 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:54 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-7ebb6c29-b9c3-454e-ac8b-11d2558876cd tempest-ServerActionsTestOtherA-2024956670 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:54 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-7ebb6c29-b9c3-454e-ac8b-11d2558876cd tempest-ServerActionsTestOtherA-2024956670 None] Deleted volume successfully. Nov 03 13:13:54 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-7ebb6c29-b9c3-454e-ac8b-11d2558876cd tempest-ServerActionsTestOtherA-2024956670 None] Lock "cinder-cfbaad03-ad94-4aa4-9908-bed601c27244-delete_volume" released by "delete_volume" :: held 2.155s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:55 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71309e0f-ae4e-4070-8904-6b2fc7b0051b" returned: 0 in 0.266s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:55 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] Lock "cinder-quobyte-71309e0f-ae4e-4070-8904-6b2fc7b0051b" released by "_copy_volume_from_snapshot" :: held 10.732s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:55 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] Lock "cinder-quobyte-1932c8b0-9334-4884-be84-c773cd827305-71309e0f-ae4e-4070-8904-6b2fc7b0051b" released by "_create_volume_from_snapshot" :: held 10.832s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.876s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.581s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:55 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2101090416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a9cb70-3878-4d6e-8ee2-9bbaf18882ae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d4e5b56190bf4ff0bbd5133ab08fe645',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:46Z,use_quota=True,user_id='88fd6523a52d431f8048953431af807e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:13:55 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] Creating volume 51a9cb70-3878-4d6e-8ee2-9bbaf18882ae {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:13:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:55 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:55 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:55 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:13:55 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:13:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-51a9cb70-3878-4d6e-8ee2-9bbaf18882ae 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:55 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-51a9cb70-3878-4d6e-8ee2-9bbaf18882ae 1073741824 Nov 03 13:13:55 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:55 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-030cae08-b05d-4a8b-bde6-931955862f09 tempest-GroupSnapshotsTest-1856318917 None] Create group from source-snapshot-0ffa779a-71f4-41c5-8518-4c4dfef3966b completed successfully. Nov 03 13:13:56 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-51a9cb70-3878-4d6e-8ee2-9bbaf18882ae 1073741824" returned: 0 in 0.927s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-51a9cb70-3878-4d6e-8ee2-9bbaf18882ae {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:56 devstack sudo[96817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-51a9cb70-3878-4d6e-8ee2-9bbaf18882ae Nov 03 13:13:56 devstack sudo[96817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:56 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d9fc9820-f599-415b-aef3-3665b3146131 tempest-GroupSnapshotsTest-1856318917 None] Acquiring lock "cinder-quobyte-71309e0f-ae4e-4070-8904-6b2fc7b0051b" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:56 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d9fc9820-f599-415b-aef3-3665b3146131 tempest-GroupSnapshotsTest-1856318917 None] Lock "cinder-quobyte-71309e0f-ae4e-4070-8904-6b2fc7b0051b" acquired by "delete_volume" :: waited 0.019s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:56 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9868b7-de0c-4cd4-89c3-f0da0e6af0e7]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d9fc9820-f599-415b-aef3-3665b3146131 tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71309e0f-ae4e-4070-8904-6b2fc7b0051b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:56 devstack sudo[96819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71309e0f-ae4e-4070-8904-6b2fc7b0051b Nov 03 13:13:56 devstack sudo[96819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:56 devstack sudo[96817]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-51a9cb70-3878-4d6e-8ee2-9bbaf18882ae" returned: 0 in 0.489s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:56 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:13:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49ae6eb4-12c9-4070-ae47-47639ba98565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51a9cb70-3878-4d6e-8ee2-9bbaf18882ae', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e2b03c-5ae0-41be-aada-d9fb85606356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:56 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] Volume volume-51a9cb70-3878-4d6e-8ee2-9bbaf18882ae (51a9cb70-3878-4d6e-8ee2-9bbaf18882ae): created successfully Nov 03 13:13:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e2b03c-5ae0-41be-aada-d9fb85606356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] Flow 'volume_create_manager' (b6936915-90e3-49de-b8a0-9d016678b58e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:56 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-ccb5188b-eba8-4bcd-b38c-c220ee535937 tempest-VolumesListTestJSON-566154618 None] Created volume successfully. Nov 03 13:13:56 devstack sudo[96819]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d9fc9820-f599-415b-aef3-3665b3146131 tempest-GroupSnapshotsTest-1856318917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71309e0f-ae4e-4070-8904-6b2fc7b0051b" returned: 0 in 0.567s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d9fc9820-f599-415b-aef3-3665b3146131 tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71309e0f-ae4e-4070-8904-6b2fc7b0051b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:57 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71309e0f-ae4e-4070-8904-6b2fc7b0051b Nov 03 13:13:57 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:57 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d9fc9820-f599-415b-aef3-3665b3146131 tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71309e0f-ae4e-4070-8904-6b2fc7b0051b" returned: 0 in 0.277s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:57 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d9fc9820-f599-415b-aef3-3665b3146131 tempest-GroupSnapshotsTest-1856318917 None] Lock "cinder-quobyte-71309e0f-ae4e-4070-8904-6b2fc7b0051b" released by "delete_volume" :: held 0.945s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:57 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-d9fc9820-f599-415b-aef3-3665b3146131 tempest-GroupSnapshotsTest-1856318917 None] Created reservations ['84ed9e97-2228-46f3-a3b7-712abdc21ebe'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:57 devstack cinder-volume[86725]: WARNING cinder.quota [None req-d9fc9820-f599-415b-aef3-3665b3146131 tempest-GroupSnapshotsTest-1856318917 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-643599167 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-643599167, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:13:57 devstack cinder-volume[86725]: WARNING cinder.quota [None req-d9fc9820-f599-415b-aef3-3665b3146131 tempest-GroupSnapshotsTest-1856318917 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-643599167 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-643599167, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:13:57 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-d9fc9820-f599-415b-aef3-3665b3146131 tempest-GroupSnapshotsTest-1856318917 None] Created reservations ['82924936-da1f-4b39-8ed0-36b1d91890e2', '3f189a85-45ae-4e19-a22e-22777bfcfe36', '4bdfd08d-105f-4aa0-8231-4ee2bfe2669b', '011f79b9-066f-47b3-96a4-ff06d20e3052'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d9fc9820-f599-415b-aef3-3665b3146131 tempest-GroupSnapshotsTest-1856318917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d9fc9820-f599-415b-aef3-3665b3146131 tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:57 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d9fc9820-f599-415b-aef3-3665b3146131 tempest-GroupSnapshotsTest-1856318917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:57 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d9fc9820-f599-415b-aef3-3665b3146131 tempest-GroupSnapshotsTest-1856318917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d9fc9820-f599-415b-aef3-3665b3146131 tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d9fc9820-f599-415b-aef3-3665b3146131 tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:57 devstack sudo[96830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:13:57 devstack sudo[96830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:57 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-14ede29e-e2ef-42f5-936c-339eea865891 tempest-GroupSnapshotsTest-1856318917 None] group_snapshot 0ffa779a-71f4-41c5-8518-4c4dfef3966b: deleting Nov 03 13:13:57 devstack sudo[96830]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d9fc9820-f599-415b-aef3-3665b3146131 tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.371s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:57 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-d9fc9820-f599-415b-aef3-3665b3146131 tempest-GroupSnapshotsTest-1856318917 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:57 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-14ede29e-e2ef-42f5-936c-339eea865891 tempest-GroupSnapshotsTest-1856318917 None] group_snapshot 0ffa779a-71f4-41c5-8518-4c4dfef3966b: deleting {{(pid=86725) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 13:13:57 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-d9fc9820-f599-415b-aef3-3665b3146131 tempest-GroupSnapshotsTest-1856318917 None] Delete group completed successfully. Nov 03 13:13:57 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-14ede29e-e2ef-42f5-936c-339eea865891 tempest-GroupSnapshotsTest-1856318917 None] Acquiring lock "cinder-quobyte-986b9d45-9926-4833-bd5c-95f65df42859" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:57 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-14ede29e-e2ef-42f5-936c-339eea865891 tempest-GroupSnapshotsTest-1856318917 None] Lock "cinder-quobyte-986b9d45-9926-4833-bd5c-95f65df42859" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:57 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-14ede29e-e2ef-42f5-936c-339eea865891 tempest-GroupSnapshotsTest-1856318917 None] Acquiring lock "cinder-quobyte-1932c8b0-9334-4884-be84-c773cd827305" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-14ede29e-e2ef-42f5-936c-339eea865891 tempest-GroupSnapshotsTest-1856318917 None] Lock "cinder-quobyte-1932c8b0-9334-4884-be84-c773cd827305" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-14ede29e-e2ef-42f5-936c-339eea865891 tempest-GroupSnapshotsTest-1856318917 None] Deleting offline snapshot 1932c8b0-9334-4884-be84-c773cd827305 of volume 986b9d45-9926-4833-bd5c-95f65df42859 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-14ede29e-e2ef-42f5-936c-339eea865891 tempest-GroupSnapshotsTest-1856318917 None] snapshot_file for this snap is: volume-986b9d45-9926-4833-bd5c-95f65df42859.1932c8b0-9334-4884-be84-c773cd827305 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7de51c-af81-442a-8f8f-6ccfa361dc5b]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-14ede29e-e2ef-42f5-936c-339eea865891 tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859.1932c8b0-9334-4884-be84-c773cd827305 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:58 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859.1932c8b0-9334-4884-be84-c773cd827305 Nov 03 13:13:58 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:58 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-14ede29e-e2ef-42f5-936c-339eea865891 tempest-GroupSnapshotsTest-1856318917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859.1932c8b0-9334-4884-be84-c773cd827305" returned: 0 in 0.547s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-14ede29e-e2ef-42f5-936c-339eea865891 tempest-GroupSnapshotsTest-1856318917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-986b9d45-9926-4833-bd5c-95f65df42859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2e8960-a792-429f-a8ae-70fd7747ad92]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-14ede29e-e2ef-42f5-936c-339eea865891 tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] Flow 'volume_create_manager' (4ee126f1-3af2-4179-80a0-937127a6791b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17a6319c-c296-4b5b-9ca5-0c4e0e9b8255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17a6319c-c296-4b5b-9ca5-0c4e0e9b8255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-988563174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffe3f6ad-95d0-4bad-83f0-9cb4e96ad13d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d4e5b56190bf4ff0bbd5133ab08fe645',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:59Z,use_quota=True,user_id='88fd6523a52d431f8048953431af807e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa97cc06-4436-4d48-964e-92d6041e8d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa97cc06-4436-4d48-964e-92d6041e8d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33408325-40a7-4c04-99b1-092c3c0cd053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33408325-40a7-4c04-99b1-092c3c0cd053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffe3f6ad-95d0-4bad-83f0-9cb4e96ad13d', 'volume_name': 'volume-ffe3f6ad-95d0-4bad-83f0-9cb4e96ad13d', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a287754c-0d29-4fb8-a80f-17828623f063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a287754c-0d29-4fb8-a80f-17828623f063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e18c87-da0b-4ea9-80bd-6a8a87e7fd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:58 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] Volume ffe3f6ad-95d0-4bad-83f0-9cb4e96ad13d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffe3f6ad-95d0-4bad-83f0-9cb4e96ad13d', 'volume_size': 1} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-988563174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffe3f6ad-95d0-4bad-83f0-9cb4e96ad13d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d4e5b56190bf4ff0bbd5133ab08fe645',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:59Z,use_quota=True,user_id='88fd6523a52d431f8048953431af807e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] Creating volume ffe3f6ad-95d0-4bad-83f0-9cb4e96ad13d {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:13:58 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ffe3f6ad-95d0-4bad-83f0-9cb4e96ad13d 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:58 devstack sudo[96839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859 Nov 03 13:13:58 devstack sudo[96839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:58 devstack sudo[96840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ffe3f6ad-95d0-4bad-83f0-9cb4e96ad13d 1073741824 Nov 03 13:13:58 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:58 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:13:58 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:59 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.396s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:59 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:59 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager._thread_info {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:13:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread count: 28 {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:13:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread info: [<_MainThread(MainThread, started 133507074375808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:13:59 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ffe3f6ad-95d0-4bad-83f0-9cb4e96ad13d 1073741824" returned: 0 in 0.615s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:59 devstack sudo[96839]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-14ede29e-e2ef-42f5-936c-339eea865891 tempest-GroupSnapshotsTest-1856318917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859" returned: 0 in 0.782s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-14ede29e-e2ef-42f5-936c-339eea865891 tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859.1932c8b0-9334-4884-be84-c773cd827305 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ffe3f6ad-95d0-4bad-83f0-9cb4e96ad13d {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:59 devstack sudo[96854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859.1932c8b0-9334-4884-be84-c773cd827305 Nov 03 13:13:59 devstack sudo[96854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:59 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ffe3f6ad-95d0-4bad-83f0-9cb4e96ad13d Nov 03 13:13:59 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:59 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ffe3f6ad-95d0-4bad-83f0-9cb4e96ad13d" returned: 0 in 0.324s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:59 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:13:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e18c87-da0b-4ea9-80bd-6a8a87e7fd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffe3f6ad-95d0-4bad-83f0-9cb4e96ad13d', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc0fbb95-a855-4b95-a381-04a267a34aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:59 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] Volume volume-ffe3f6ad-95d0-4bad-83f0-9cb4e96ad13d (ffe3f6ad-95d0-4bad-83f0-9cb4e96ad13d): created successfully Nov 03 13:13:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc0fbb95-a855-4b95-a381-04a267a34aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] Flow 'volume_create_manager' (4ee126f1-3af2-4179-80a0-937127a6791b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:59 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-4784eb69-d114-449e-8c59-e493ed3b5ea4 tempest-VolumesListTestJSON-566154618 None] Created volume successfully. Nov 03 13:13:59 devstack sudo[96854]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-14ede29e-e2ef-42f5-936c-339eea865891 tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859.1932c8b0-9334-4884-be84-c773cd827305" returned: 0 in 0.482s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-14ede29e-e2ef-42f5-936c-339eea865891 tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859.1932c8b0-9334-4884-be84-c773cd827305 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:59 devstack sudo[96862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859.1932c8b0-9334-4884-be84-c773cd827305 Nov 03 13:13:59 devstack sudo[96862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:00 devstack sudo[96862]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-14ede29e-e2ef-42f5-936c-339eea865891 tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859.1932c8b0-9334-4884-be84-c773cd827305" returned: 0 in 0.277s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-14ede29e-e2ef-42f5-936c-339eea865891 tempest-GroupSnapshotsTest-1856318917 None] Lock "cinder-quobyte-1932c8b0-9334-4884-be84-c773cd827305" released by "_delete_snapshot" :: held 2.221s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-14ede29e-e2ef-42f5-936c-339eea865891 tempest-GroupSnapshotsTest-1856318917 None] Lock "cinder-quobyte-986b9d45-9926-4833-bd5c-95f65df42859" released by "delete_snapshot" :: held 2.249s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:00 devstack cinder-volume[86725]: WARNING cinder.quota [None req-14ede29e-e2ef-42f5-936c-339eea865891 tempest-GroupSnapshotsTest-1856318917 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-643599167 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-643599167, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:14:00 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-14ede29e-e2ef-42f5-936c-339eea865891 tempest-GroupSnapshotsTest-1856318917 None] Created reservations ['98620292-ad61-41f2-9af8-3f0f0c23d051', 'd57b7771-63d1-4990-ae38-e7554223dfa1', 'acaf98da-0437-45ca-ad72-1503215cc306', '87d3ca44-c464-4261-a16c-21e6d4ce5ade'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:00 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-14ede29e-e2ef-42f5-936c-339eea865891 tempest-GroupSnapshotsTest-1856318917 None] group_snapshot 0ffa779a-71f4-41c5-8518-4c4dfef3966b: deleted successfully Nov 03 13:14:01 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:14:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Flow 'volume_create_manager' (c0de51d3-66ff-4065-a5a7-a37189ec709d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (636b0d1b-a233-435d-b86b-6f0a767c52ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-dc47dadb-eda5-4018-9123-2f43e221e04b tempest-GroupSnapshotsTest-1856318917 None] Acquiring lock "cinder-quobyte-986b9d45-9926-4833-bd5c-95f65df42859" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (636b0d1b-a233-435d-b86b-6f0a767c52ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-188121544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a904531d-1470-4ab4-9dd9-cac8cf73cd35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deb2bf37882d4f50a8dbf8c70a117495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:02Z,use_quota=True,user_id='4385927ad6bd4620ac17b3469d4e6200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce12b258-3eeb-4332-9794-48b08173fac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce12b258-3eeb-4332-9794-48b08173fac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db4da3a0-cfb1-47e1-8b48-f2a5129ae310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db4da3a0-cfb1-47e1-8b48-f2a5129ae310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a904531d-1470-4ab4-9dd9-cac8cf73cd35', 'volume_name': 'volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3b4efb-800c-4b80-ba6f-cf7075697188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3b4efb-800c-4b80-ba6f-cf7075697188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f41ebe-eed4-454b-ab9b-6b2c931392c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:01 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Volume a904531d-1470-4ab4-9dd9-cac8cf73cd35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35', 'volume_size': 1} Nov 03 13:14:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:01 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-188121544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a904531d-1470-4ab4-9dd9-cac8cf73cd35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deb2bf37882d4f50a8dbf8c70a117495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:02Z,use_quota=True,user_id='4385927ad6bd4620ac17b3469d4e6200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:14:01 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Creating volume a904531d-1470-4ab4-9dd9-cac8cf73cd35 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:14:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:01 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:01 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:01 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:14:01 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:14:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-dc47dadb-eda5-4018-9123-2f43e221e04b tempest-GroupSnapshotsTest-1856318917 None] Lock "cinder-quobyte-986b9d45-9926-4833-bd5c-95f65df42859" acquired by "delete_volume" :: waited 0.109s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:02 devstack sudo[96866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35 1073741824 Nov 03 13:14:02 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:02 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd422ac8-d9a9-4a2d-84fa-6d3effc55fba]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-dc47dadb-eda5-4018-9123-2f43e221e04b tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:02 devstack sudo[96868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859 Nov 03 13:14:02 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:02 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35 1073741824" returned: 0 in 0.570s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:02 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-dc47dadb-eda5-4018-9123-2f43e221e04b tempest-GroupSnapshotsTest-1856318917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859" returned: 0 in 0.499s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-dc47dadb-eda5-4018-9123-2f43e221e04b tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:02 devstack sudo[96877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859 Nov 03 13:14:02 devstack sudo[96877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:02 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35 Nov 03 13:14:02 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:02 devstack sudo[96877]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-dc47dadb-eda5-4018-9123-2f43e221e04b tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-986b9d45-9926-4833-bd5c-95f65df42859" returned: 0 in 0.339s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-dc47dadb-eda5-4018-9123-2f43e221e04b tempest-GroupSnapshotsTest-1856318917 None] Lock "cinder-quobyte-986b9d45-9926-4833-bd5c-95f65df42859" released by "delete_volume" :: held 0.942s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:03 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35" returned: 0 in 0.382s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:03 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:14:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:03 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f41ebe-eed4-454b-ab9b-6b2c931392c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:03 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f77e4097-768c-4c49-ba2e-7680b14fbb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:03 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Volume volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35 (a904531d-1470-4ab4-9dd9-cac8cf73cd35): created successfully Nov 03 13:14:03 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f77e4097-768c-4c49-ba2e-7680b14fbb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:03 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Flow 'volume_create_manager' (c0de51d3-66ff-4065-a5a7-a37189ec709d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:03 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-dc47dadb-eda5-4018-9123-2f43e221e04b tempest-GroupSnapshotsTest-1856318917 None] Created reservations ['988f37fd-5564-4325-998b-09ed9d0e78a4'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:03 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-bad2429b-22ef-4f86-9eaf-d5402c101523 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Created volume successfully. Nov 03 13:14:03 devstack cinder-volume[86725]: WARNING cinder.db.api [None req-dc47dadb-eda5-4018-9123-2f43e221e04b tempest-GroupSnapshotsTest-1856318917 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-643599167'] Nov 03 13:14:03 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-dc47dadb-eda5-4018-9123-2f43e221e04b tempest-GroupSnapshotsTest-1856318917 None] Created reservations ['e5dbde15-b33d-4b04-b4a8-7b0406f4c48a', 'fd4a7705-1431-477f-be37-3577ed93cb76', '600dd8bf-c129-4039-8093-e5e919b81c0a', 'd0b85989-42ec-4fb9-b7c4-cd7cb98d83d0'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:03 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-32e59368-c400-4285-8ce9-2168e0012c5d tempest-VolumesListTestJSON-566154618 None] Acquiring lock "cinder-ffe3f6ad-95d0-4bad-83f0-9cb4e96ad13d-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:03 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-32e59368-c400-4285-8ce9-2168e0012c5d tempest-VolumesListTestJSON-566154618 None] Lock "cinder-ffe3f6ad-95d0-4bad-83f0-9cb4e96ad13d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:03 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-32e59368-c400-4285-8ce9-2168e0012c5d tempest-VolumesListTestJSON-566154618 None] Acquiring lock "cinder-quobyte-ffe3f6ad-95d0-4bad-83f0-9cb4e96ad13d" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:03 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-32e59368-c400-4285-8ce9-2168e0012c5d tempest-VolumesListTestJSON-566154618 None] Lock "cinder-quobyte-ffe3f6ad-95d0-4bad-83f0-9cb4e96ad13d" acquired by "delete_volume" :: waited 0.021s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:03 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[80aa5dbb-8467-4a97-886a-20b614cc7bc6]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-32e59368-c400-4285-8ce9-2168e0012c5d tempest-VolumesListTestJSON-566154618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ffe3f6ad-95d0-4bad-83f0-9cb4e96ad13d {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-dc47dadb-eda5-4018-9123-2f43e221e04b tempest-GroupSnapshotsTest-1856318917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-dc47dadb-eda5-4018-9123-2f43e221e04b tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:03 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-dc47dadb-eda5-4018-9123-2f43e221e04b tempest-GroupSnapshotsTest-1856318917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:03 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-dc47dadb-eda5-4018-9123-2f43e221e04b tempest-GroupSnapshotsTest-1856318917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-dc47dadb-eda5-4018-9123-2f43e221e04b tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-dc47dadb-eda5-4018-9123-2f43e221e04b tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:03 devstack sudo[96884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:14:03 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:03 devstack sudo[96883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ffe3f6ad-95d0-4bad-83f0-9cb4e96ad13d Nov 03 13:14:03 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:03 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-dc47dadb-eda5-4018-9123-2f43e221e04b tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.280s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:03 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-dc47dadb-eda5-4018-9123-2f43e221e04b tempest-GroupSnapshotsTest-1856318917 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:14:03 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-dc47dadb-eda5-4018-9123-2f43e221e04b tempest-GroupSnapshotsTest-1856318917 None] Delete group completed successfully. Nov 03 13:14:03 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-32e59368-c400-4285-8ce9-2168e0012c5d tempest-VolumesListTestJSON-566154618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ffe3f6ad-95d0-4bad-83f0-9cb4e96ad13d" returned: 0 in 0.446s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-32e59368-c400-4285-8ce9-2168e0012c5d tempest-VolumesListTestJSON-566154618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ffe3f6ad-95d0-4bad-83f0-9cb4e96ad13d {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:03 devstack sudo[96891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ffe3f6ad-95d0-4bad-83f0-9cb4e96ad13d Nov 03 13:14:03 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:04 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-32e59368-c400-4285-8ce9-2168e0012c5d tempest-VolumesListTestJSON-566154618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ffe3f6ad-95d0-4bad-83f0-9cb4e96ad13d" returned: 0 in 0.314s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:04 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-32e59368-c400-4285-8ce9-2168e0012c5d tempest-VolumesListTestJSON-566154618 None] Lock "cinder-quobyte-ffe3f6ad-95d0-4bad-83f0-9cb4e96ad13d" released by "delete_volume" :: held 0.842s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e955b848-6bc6-4fa0-ac5c-711aedb0d17b tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e955b848-6bc6-4fa0-ac5c-711aedb0d17b tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:04 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-e955b848-6bc6-4fa0-ac5c-711aedb0d17b tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Creating offline snapshot 93010516-a5b3-45be-9e57-3326d5cef3e2 of volume a904531d-1470-4ab4-9dd9-cac8cf73cd35 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:14:04 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-32e59368-c400-4285-8ce9-2168e0012c5d tempest-VolumesListTestJSON-566154618 None] Created reservations ['4ee0e62e-7d0e-44ed-aa1c-9d447c2da150', '79e6f09d-3063-4ea2-9e92-dce163288085', '13c4e1bc-dc6d-4b5e-be06-8bb61361aca8', 'dfd196c5-6781-4486-9743-88d584589cd8'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:04 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e29224-047c-442a-ac86-51bd3853a579]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e955b848-6bc6-4fa0-ac5c-711aedb0d17b tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-32e59368-c400-4285-8ce9-2168e0012c5d tempest-VolumesListTestJSON-566154618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-32e59368-c400-4285-8ce9-2168e0012c5d tempest-VolumesListTestJSON-566154618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:04 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-32e59368-c400-4285-8ce9-2168e0012c5d tempest-VolumesListTestJSON-566154618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:04 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-32e59368-c400-4285-8ce9-2168e0012c5d tempest-VolumesListTestJSON-566154618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-32e59368-c400-4285-8ce9-2168e0012c5d tempest-VolumesListTestJSON-566154618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-32e59368-c400-4285-8ce9-2168e0012c5d tempest-VolumesListTestJSON-566154618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:04 devstack sudo[96895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:14:04 devstack sudo[96895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:04 devstack sudo[96894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35 Nov 03 13:14:04 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:04 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b343cfbc-2b26-4121-965a-8f8815ee4a57 tempest-VolumesListTestJSON-566154618 None] Acquiring lock "cinder-51a9cb70-3878-4d6e-8ee2-9bbaf18882ae-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:04 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b343cfbc-2b26-4121-965a-8f8815ee4a57 tempest-VolumesListTestJSON-566154618 None] Lock "cinder-51a9cb70-3878-4d6e-8ee2-9bbaf18882ae-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:04 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b343cfbc-2b26-4121-965a-8f8815ee4a57 tempest-VolumesListTestJSON-566154618 None] Acquiring lock "cinder-quobyte-51a9cb70-3878-4d6e-8ee2-9bbaf18882ae" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:04 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b343cfbc-2b26-4121-965a-8f8815ee4a57 tempest-VolumesListTestJSON-566154618 None] Lock "cinder-quobyte-51a9cb70-3878-4d6e-8ee2-9bbaf18882ae" acquired by "delete_volume" :: waited 0.035s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:04 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[302b02e5-fd46-465f-a808-19bb48fa5585]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b343cfbc-2b26-4121-965a-8f8815ee4a57 tempest-VolumesListTestJSON-566154618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-51a9cb70-3878-4d6e-8ee2-9bbaf18882ae {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:04 devstack sudo[96895]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-32e59368-c400-4285-8ce9-2168e0012c5d tempest-VolumesListTestJSON-566154618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.390s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:04 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-32e59368-c400-4285-8ce9-2168e0012c5d tempest-VolumesListTestJSON-566154618 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:14:04 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-32e59368-c400-4285-8ce9-2168e0012c5d tempest-VolumesListTestJSON-566154618 None] Deleted volume successfully. Nov 03 13:14:04 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-32e59368-c400-4285-8ce9-2168e0012c5d tempest-VolumesListTestJSON-566154618 None] Lock "cinder-ffe3f6ad-95d0-4bad-83f0-9cb4e96ad13d-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:04 devstack sudo[96899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-51a9cb70-3878-4d6e-8ee2-9bbaf18882ae Nov 03 13:14:04 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:04 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e955b848-6bc6-4fa0-ac5c-711aedb0d17b tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35" returned: 0 in 0.756s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e955b848-6bc6-4fa0-ac5c-711aedb0d17b tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35.93010516-a5b3-45be-9e57-3326d5cef3e2 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:04 devstack sudo[96905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35.93010516-a5b3-45be-9e57-3326d5cef3e2 1G Nov 03 13:14:04 devstack sudo[96905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:05 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-6a575b34-0fa2-497c-b7d5-fe12b8fae775 tempest-GroupSnapshotsTest-1856318917 None] Group tempest-GroupSnapshotsTest-Group-1665856239: creating Nov 03 13:14:05 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-6a575b34-0fa2-497c-b7d5-fe12b8fae775 tempest-GroupSnapshotsTest-1856318917 None] Group tempest-GroupSnapshotsTest-Group-1665856239: created successfully Nov 03 13:14:05 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-6a575b34-0fa2-497c-b7d5-fe12b8fae775 tempest-GroupSnapshotsTest-1856318917 None] Create group completed successfully. Nov 03 13:14:05 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b343cfbc-2b26-4121-965a-8f8815ee4a57 tempest-VolumesListTestJSON-566154618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-51a9cb70-3878-4d6e-8ee2-9bbaf18882ae" returned: 0 in 0.573s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b343cfbc-2b26-4121-965a-8f8815ee4a57 tempest-VolumesListTestJSON-566154618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-51a9cb70-3878-4d6e-8ee2-9bbaf18882ae {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:05 devstack sudo[96912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-51a9cb70-3878-4d6e-8ee2-9bbaf18882ae Nov 03 13:14:05 devstack sudo[96912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:05 devstack sudo[96905]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e955b848-6bc6-4fa0-ac5c-711aedb0d17b tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35.93010516-a5b3-45be-9e57-3326d5cef3e2 1G" returned: 0 in 0.567s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e955b848-6bc6-4fa0-ac5c-711aedb0d17b tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35.93010516-a5b3-45be-9e57-3326d5cef3e2 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:05 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35.93010516-a5b3-45be-9e57-3326d5cef3e2 Nov 03 13:14:05 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:05 devstack sudo[96912]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b343cfbc-2b26-4121-965a-8f8815ee4a57 tempest-VolumesListTestJSON-566154618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-51a9cb70-3878-4d6e-8ee2-9bbaf18882ae" returned: 0 in 0.294s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:05 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b343cfbc-2b26-4121-965a-8f8815ee4a57 tempest-VolumesListTestJSON-566154618 None] Lock "cinder-quobyte-51a9cb70-3878-4d6e-8ee2-9bbaf18882ae" released by "delete_volume" :: held 0.948s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:05 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-b343cfbc-2b26-4121-965a-8f8815ee4a57 tempest-VolumesListTestJSON-566154618 None] Created reservations ['b71e39a3-f2ef-4e78-9a93-e483a37c2a94', '50c107b9-2656-40e3-8276-21efec4d0017', '24cc368a-e1b2-4c28-9cd5-af6cd59485e6', 'c032ba2d-5224-49e8-ad68-e6976cec2ee2'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b343cfbc-2b26-4121-965a-8f8815ee4a57 tempest-VolumesListTestJSON-566154618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b343cfbc-2b26-4121-965a-8f8815ee4a57 tempest-VolumesListTestJSON-566154618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:05 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b343cfbc-2b26-4121-965a-8f8815ee4a57 tempest-VolumesListTestJSON-566154618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:05 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b343cfbc-2b26-4121-965a-8f8815ee4a57 tempest-VolumesListTestJSON-566154618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b343cfbc-2b26-4121-965a-8f8815ee4a57 tempest-VolumesListTestJSON-566154618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b343cfbc-2b26-4121-965a-8f8815ee4a57 tempest-VolumesListTestJSON-566154618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:05 devstack sudo[96921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:14:05 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:05 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e955b848-6bc6-4fa0-ac5c-711aedb0d17b tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35.93010516-a5b3-45be-9e57-3326d5cef3e2" returned: 0 in 0.338s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:05 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-e955b848-6bc6-4fa0-ac5c-711aedb0d17b tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35.93010516-a5b3-45be-9e57-3326d5cef3e2 is being set with open permissions: ugo+rw Nov 03 13:14:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e955b848-6bc6-4fa0-ac5c-711aedb0d17b tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35.93010516-a5b3-45be-9e57-3326d5cef3e2 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:05 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35.93010516-a5b3-45be-9e57-3326d5cef3e2 Nov 03 13:14:05 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:06 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b343cfbc-2b26-4121-965a-8f8815ee4a57 tempest-VolumesListTestJSON-566154618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.300s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:06 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-b343cfbc-2b26-4121-965a-8f8815ee4a57 tempest-VolumesListTestJSON-566154618 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:14:06 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-b343cfbc-2b26-4121-965a-8f8815ee4a57 tempest-VolumesListTestJSON-566154618 None] Deleted volume successfully. Nov 03 13:14:06 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b343cfbc-2b26-4121-965a-8f8815ee4a57 tempest-VolumesListTestJSON-566154618 None] Lock "cinder-51a9cb70-3878-4d6e-8ee2-9bbaf18882ae-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:06 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e955b848-6bc6-4fa0-ac5c-711aedb0d17b tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35.93010516-a5b3-45be-9e57-3326d5cef3e2" returned: 0 in 0.293s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e955b848-6bc6-4fa0-ac5c-711aedb0d17b tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:06 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35.info Nov 03 13:14:06 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:06 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e955b848-6bc6-4fa0-ac5c-711aedb0d17b tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35.info" returned: 0 in 0.268s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:06 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-e955b848-6bc6-4fa0-ac5c-711aedb0d17b tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35.info is being set with open permissions: ugo+rw Nov 03 13:14:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e955b848-6bc6-4fa0-ac5c-711aedb0d17b tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:06 devstack sudo[96931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35.info Nov 03 13:14:06 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:06 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e955b848-6bc6-4fa0-ac5c-711aedb0d17b tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35.info" returned: 0 in 0.351s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e955b848-6bc6-4fa0-ac5c-711aedb0d17b tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.694s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:06 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5485752f-c8a0-4c59-abc6-a1fffc333a31 tempest-VolumesListTestJSON-566154618 None] Acquiring lock "cinder-64e043d2-3115-4146-b365-cc5e5ae71688-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:06 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:14:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] Flow 'volume_create_manager' (da40d146-b10f-4658-b672-a2b5b7908164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f568b4c2-d2ad-42b2-afd3-71a108aba1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f568b4c2-d2ad-42b2-afd3-71a108aba1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-247659960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3db5fc0d-af24-48b0-8053-e78c0d2367f6,host='devstack@QuobyteHD#QuobyteHD',id=0e74d797-ed12-4a83-9967-9a012f1530fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64ad2c04c3064b0cb6e157c387cb14e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:07Z,use_quota=True,user_id='5dcd966f7a8541568b9f73e8f8174231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b67327e4-9b96-4084-9627-b6fcc745b1c3),volume_type_id=b67327e4-9b96-4084-9627-b6fcc745b1c3)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f6bc549-7ac4-4829-86df-94bf3dbf2249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f6bc549-7ac4-4829-86df-94bf3dbf2249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a827d6b-23c2-4c78-ab9a-c73e81a428e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a827d6b-23c2-4c78-ab9a-c73e81a428e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e74d797-ed12-4a83-9967-9a012f1530fc', 'volume_name': 'volume-0e74d797-ed12-4a83-9967-9a012f1530fc', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8296fbc-46b9-4d6f-8d8f-de3780c1efcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8296fbc-46b9-4d6f-8d8f-de3780c1efcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bd2f00b-7f77-4897-a30e-2c0610aa85fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:06 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] Volume 0e74d797-ed12-4a83-9967-9a012f1530fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e74d797-ed12-4a83-9967-9a012f1530fc', 'volume_size': 1} Nov 03 13:14:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:06 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3db5fc0d-af24-48b0-8053-e78c0d2367f6,created_at=2026-11-03T12:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-247659960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3db5fc0d-af24-48b0-8053-e78c0d2367f6,host='devstack@QuobyteHD#QuobyteHD',id=0e74d797-ed12-4a83-9967-9a012f1530fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64ad2c04c3064b0cb6e157c387cb14e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:07Z,use_quota=True,user_id='5dcd966f7a8541568b9f73e8f8174231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b67327e4-9b96-4084-9627-b6fcc745b1c3),volume_type_id=b67327e4-9b96-4084-9627-b6fcc745b1c3)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:14:06 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] Creating volume 0e74d797-ed12-4a83-9967-9a012f1530fc {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:14:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:06 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:06 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:06 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:14:06 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:14:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:06 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5485752f-c8a0-4c59-abc6-a1fffc333a31 tempest-VolumesListTestJSON-566154618 None] Lock "cinder-64e043d2-3115-4146-b365-cc5e5ae71688-delete_volume" acquired by "delete_volume" :: waited 0.139s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:06 devstack sudo[96934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc 1073741824 Nov 03 13:14:06 devstack sudo[96934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:06 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-e955b848-6bc6-4fa0-ac5c-711aedb0d17b tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Create snapshot completed successfully Nov 03 13:14:07 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5485752f-c8a0-4c59-abc6-a1fffc333a31 tempest-VolumesListTestJSON-566154618 None] Acquiring lock "cinder-quobyte-64e043d2-3115-4146-b365-cc5e5ae71688" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:07 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5485752f-c8a0-4c59-abc6-a1fffc333a31 tempest-VolumesListTestJSON-566154618 None] Lock "cinder-quobyte-64e043d2-3115-4146-b365-cc5e5ae71688" acquired by "delete_volume" :: waited 0.016s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:07 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[1477fb6d-f98e-4fd5-9928-801cc62deeaf]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5485752f-c8a0-4c59-abc6-a1fffc333a31 tempest-VolumesListTestJSON-566154618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-64e043d2-3115-4146-b365-cc5e5ae71688 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:07 devstack sudo[96936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-64e043d2-3115-4146-b365-cc5e5ae71688 Nov 03 13:14:07 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:07 devstack sudo[96934]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc 1073741824" returned: 0 in 0.538s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:07 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5485752f-c8a0-4c59-abc6-a1fffc333a31 tempest-VolumesListTestJSON-566154618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-64e043d2-3115-4146-b365-cc5e5ae71688" returned: 0 in 0.459s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5485752f-c8a0-4c59-abc6-a1fffc333a31 tempest-VolumesListTestJSON-566154618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-64e043d2-3115-4146-b365-cc5e5ae71688 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:07 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-64e043d2-3115-4146-b365-cc5e5ae71688 Nov 03 13:14:07 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:07 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc Nov 03 13:14:07 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:07 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5485752f-c8a0-4c59-abc6-a1fffc333a31 tempest-VolumesListTestJSON-566154618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-64e043d2-3115-4146-b365-cc5e5ae71688" returned: 0 in 0.284s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:07 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5485752f-c8a0-4c59-abc6-a1fffc333a31 tempest-VolumesListTestJSON-566154618 None] Lock "cinder-quobyte-64e043d2-3115-4146-b365-cc5e5ae71688" released by "delete_volume" :: held 0.793s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:07 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc" returned: 0 in 0.359s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:07 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:14:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bd2f00b-7f77-4897-a30e-2c0610aa85fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e74d797-ed12-4a83-9967-9a012f1530fc', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97012683-9065-49ce-978b-b08158769114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:07 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-5485752f-c8a0-4c59-abc6-a1fffc333a31 tempest-VolumesListTestJSON-566154618 None] Created reservations ['a6eded38-3d73-4e4e-aae2-bbc10e4d3f95', '410d7c0a-ee93-495d-b17e-42f0b8f07ab3', '06eae61c-af96-41e4-8008-5dab06c16912', '61ccce5d-149b-4751-86e7-ce2a3b6f9243'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:07 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] Volume volume-0e74d797-ed12-4a83-9967-9a012f1530fc (0e74d797-ed12-4a83-9967-9a012f1530fc): created successfully Nov 03 13:14:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97012683-9065-49ce-978b-b08158769114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] Flow 'volume_create_manager' (da40d146-b10f-4658-b672-a2b5b7908164) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:07 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1cf5cfad-be88-4273-a001-d739d1d0f374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Acquiring lock "cinder-93010516-a5b3-45be-9e57-3326d5cef3e2-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:08 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-60c311a7-a6ee-427a-8463-e3361c6f5b6c tempest-GroupSnapshotsTest-1856318917 None] Created volume successfully. Nov 03 13:14:08 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1cf5cfad-be88-4273-a001-d739d1d0f374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Lock "cinder-93010516-a5b3-45be-9e57-3326d5cef3e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:08 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1cf5cfad-be88-4273-a001-d739d1d0f374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Acquiring lock "cinder-quobyte-a904531d-1470-4ab4-9dd9-cac8cf73cd35" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:08 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1cf5cfad-be88-4273-a001-d739d1d0f374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Lock "cinder-quobyte-a904531d-1470-4ab4-9dd9-cac8cf73cd35" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:08 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1cf5cfad-be88-4273-a001-d739d1d0f374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Acquiring lock "cinder-quobyte-93010516-a5b3-45be-9e57-3326d5cef3e2" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:08 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1cf5cfad-be88-4273-a001-d739d1d0f374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Lock "cinder-quobyte-93010516-a5b3-45be-9e57-3326d5cef3e2" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:08 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-1cf5cfad-be88-4273-a001-d739d1d0f374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Deleting offline snapshot 93010516-a5b3-45be-9e57-3326d5cef3e2 of volume a904531d-1470-4ab4-9dd9-cac8cf73cd35 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:14:08 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-1cf5cfad-be88-4273-a001-d739d1d0f374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] snapshot_file for this snap is: volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35.93010516-a5b3-45be-9e57-3326d5cef3e2 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:14:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5485752f-c8a0-4c59-abc6-a1fffc333a31 tempest-VolumesListTestJSON-566154618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5485752f-c8a0-4c59-abc6-a1fffc333a31 tempest-VolumesListTestJSON-566154618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:08 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5485752f-c8a0-4c59-abc6-a1fffc333a31 tempest-VolumesListTestJSON-566154618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:08 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5485752f-c8a0-4c59-abc6-a1fffc333a31 tempest-VolumesListTestJSON-566154618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5485752f-c8a0-4c59-abc6-a1fffc333a31 tempest-VolumesListTestJSON-566154618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5485752f-c8a0-4c59-abc6-a1fffc333a31 tempest-VolumesListTestJSON-566154618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:08 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f39abf4-1388-4a21-8f68-6d631208102d]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1cf5cfad-be88-4273-a001-d739d1d0f374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35.93010516-a5b3-45be-9e57-3326d5cef3e2 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:08 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:14:08 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:08 devstack sudo[96952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35.93010516-a5b3-45be-9e57-3326d5cef3e2 Nov 03 13:14:08 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:08 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5485752f-c8a0-4c59-abc6-a1fffc333a31 tempest-VolumesListTestJSON-566154618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.311s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:08 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-5485752f-c8a0-4c59-abc6-a1fffc333a31 tempest-VolumesListTestJSON-566154618 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:14:08 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-5485752f-c8a0-4c59-abc6-a1fffc333a31 tempest-VolumesListTestJSON-566154618 None] Deleted volume successfully. Nov 03 13:14:08 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5485752f-c8a0-4c59-abc6-a1fffc333a31 tempest-VolumesListTestJSON-566154618 None] Lock "cinder-64e043d2-3115-4146-b365-cc5e5ae71688-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:08 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1cf5cfad-be88-4273-a001-d739d1d0f374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35.93010516-a5b3-45be-9e57-3326d5cef3e2" returned: 0 in 0.416s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:08 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-1cf5cfad-be88-4273-a001-d739d1d0f374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:14:08 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[da333b5a-e77d-47a4-a4b6-b2319a6c2324]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1cf5cfad-be88-4273-a001-d739d1d0f374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:08 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35 Nov 03 13:14:08 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:09 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1cf5cfad-be88-4273-a001-d739d1d0f374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35" returned: 0 in 0.419s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1cf5cfad-be88-4273-a001-d739d1d0f374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35.93010516-a5b3-45be-9e57-3326d5cef3e2 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:09 devstack sudo[96965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35.93010516-a5b3-45be-9e57-3326d5cef3e2 Nov 03 13:14:09 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:09 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1cf5cfad-be88-4273-a001-d739d1d0f374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35.93010516-a5b3-45be-9e57-3326d5cef3e2" returned: 0 in 0.460s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1cf5cfad-be88-4273-a001-d739d1d0f374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35.93010516-a5b3-45be-9e57-3326d5cef3e2 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:09 devstack sudo[96970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35.93010516-a5b3-45be-9e57-3326d5cef3e2 Nov 03 13:14:09 devstack sudo[96970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:09 devstack sudo[96970]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1cf5cfad-be88-4273-a001-d739d1d0f374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35.93010516-a5b3-45be-9e57-3326d5cef3e2" returned: 0 in 0.301s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:09 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1cf5cfad-be88-4273-a001-d739d1d0f374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Lock "cinder-quobyte-93010516-a5b3-45be-9e57-3326d5cef3e2" released by "_delete_snapshot" :: held 1.802s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:09 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1cf5cfad-be88-4273-a001-d739d1d0f374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Lock "cinder-quobyte-a904531d-1470-4ab4-9dd9-cac8cf73cd35" released by "delete_snapshot" :: held 1.854s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:10 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:14:10 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] Flow 'volume_create_manager' (a1a3d078-b01e-437a-ba58-fa1362cb6d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:10 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f2d162-4e44-4c84-a8b0-4e87906ee26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:10 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-1cf5cfad-be88-4273-a001-d739d1d0f374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Created reservations ['74b1d8f2-a64f-49f6-8a33-3757976743d8', '6e764ec7-35f6-4432-9776-32b40bf06677', '3d680353-e2a8-460c-8771-7251da13f555', 'ff75bf10-2f8f-4e6b-b688-5ca084f55793'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:10 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f2d162-4e44-4c84-a8b0-4e87906ee26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1877455653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3db5fc0d-af24-48b0-8053-e78c0d2367f6,host='devstack@QuobyteHD#QuobyteHD',id=be088a30-fdf4-43f3-bbee-50d5afd6e9fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64ad2c04c3064b0cb6e157c387cb14e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:10Z,use_quota=True,user_id='5dcd966f7a8541568b9f73e8f8174231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b67327e4-9b96-4084-9627-b6fcc745b1c3),volume_type_id=b67327e4-9b96-4084-9627-b6fcc745b1c3)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:10 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df146012-cf0a-4241-9978-86056da577ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:10 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df146012-cf0a-4241-9978-86056da577ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:10 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d9f22a-3a55-4f9c-836a-cd1c99dd4e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:10 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d9f22a-3a55-4f9c-836a-cd1c99dd4e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be088a30-fdf4-43f3-bbee-50d5afd6e9fa', 'volume_name': 'volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:10 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28513822-f93b-4505-a274-c85cc42ff5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:10 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28513822-f93b-4505-a274-c85cc42ff5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:10 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca615083-2c2f-4f3b-a181-bf0ad484df63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:10 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] Volume be088a30-fdf4-43f3-bbee-50d5afd6e9fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa', 'volume_size': 1} Nov 03 13:14:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:10 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3db5fc0d-af24-48b0-8053-e78c0d2367f6,created_at=2026-11-03T12:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1877455653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3db5fc0d-af24-48b0-8053-e78c0d2367f6,host='devstack@QuobyteHD#QuobyteHD',id=be088a30-fdf4-43f3-bbee-50d5afd6e9fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64ad2c04c3064b0cb6e157c387cb14e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:10Z,use_quota=True,user_id='5dcd966f7a8541568b9f73e8f8174231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b67327e4-9b96-4084-9627-b6fcc745b1c3),volume_type_id=b67327e4-9b96-4084-9627-b6fcc745b1c3)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:14:10 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] Creating volume be088a30-fdf4-43f3-bbee-50d5afd6e9fa {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:14:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:10 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:10 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:10 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:14:10 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:14:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:10 devstack sudo[96973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa 1073741824 Nov 03 13:14:10 devstack sudo[96973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:10 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-1cf5cfad-be88-4273-a001-d739d1d0f374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Delete snapshot completed successfully. Nov 03 13:14:10 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1cf5cfad-be88-4273-a001-d739d1d0f374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Lock "cinder-93010516-a5b3-45be-9e57-3326d5cef3e2-delete_snapshot" released by "delete_snapshot" :: held 2.275s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:10 devstack sudo[96973]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa 1073741824" returned: 0 in 0.555s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:10 devstack sudo[96979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa Nov 03 13:14:10 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:11 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa" returned: 0 in 0.271s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:11 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:14:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:11 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca615083-2c2f-4f3b-a181-bf0ad484df63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:11 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (556bf1b5-789d-42de-a844-760273889089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:11 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] Volume volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa (be088a30-fdf4-43f3-bbee-50d5afd6e9fa): created successfully Nov 03 13:14:11 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (556bf1b5-789d-42de-a844-760273889089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:11 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] Flow 'volume_create_manager' (a1a3d078-b01e-437a-ba58-fa1362cb6d8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:11 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-1ac142a2-84b5-4bdc-9448-7dbf4e6f1da2 tempest-GroupSnapshotsTest-1856318917 None] Created volume successfully. Nov 03 13:14:11 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4e3968f7-b1a7-4926-bb80-ba52a3194b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Acquiring lock "cinder-a904531d-1470-4ab4-9dd9-cac8cf73cd35-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:11 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4e3968f7-b1a7-4926-bb80-ba52a3194b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Lock "cinder-a904531d-1470-4ab4-9dd9-cac8cf73cd35-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:11 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4e3968f7-b1a7-4926-bb80-ba52a3194b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Acquiring lock "cinder-quobyte-a904531d-1470-4ab4-9dd9-cac8cf73cd35" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:11 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4e3968f7-b1a7-4926-bb80-ba52a3194b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Lock "cinder-quobyte-a904531d-1470-4ab4-9dd9-cac8cf73cd35" acquired by "delete_volume" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:11 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ec522f-1954-405d-b940-f876a06658ed]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4e3968f7-b1a7-4926-bb80-ba52a3194b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:11 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35 Nov 03 13:14:11 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:11 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4e3968f7-b1a7-4926-bb80-ba52a3194b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35" returned: 0 in 0.442s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4e3968f7-b1a7-4926-bb80-ba52a3194b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:11 devstack sudo[96987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35 Nov 03 13:14:11 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:12 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4e3968f7-b1a7-4926-bb80-ba52a3194b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a904531d-1470-4ab4-9dd9-cac8cf73cd35" returned: 0 in 0.270s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:12 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4e3968f7-b1a7-4926-bb80-ba52a3194b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Lock "cinder-quobyte-a904531d-1470-4ab4-9dd9-cac8cf73cd35" released by "delete_volume" :: held 0.814s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:12 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-4e3968f7-b1a7-4926-bb80-ba52a3194b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Created reservations ['7bcbe1d0-ba1c-4ea3-9beb-c0ca12597d2e', '7963a4e6-774e-4c22-aafa-46e45136488a', 'c38802cf-2a01-47ea-9fe6-227233163afb', 'aabefd91-fc67-469b-a779-627a52b9b863'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4e3968f7-b1a7-4926-bb80-ba52a3194b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4e3968f7-b1a7-4926-bb80-ba52a3194b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:12 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4e3968f7-b1a7-4926-bb80-ba52a3194b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:12 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4e3968f7-b1a7-4926-bb80-ba52a3194b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4e3968f7-b1a7-4926-bb80-ba52a3194b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4e3968f7-b1a7-4926-bb80-ba52a3194b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:12 devstack sudo[96990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:14:12 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:12 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-988afbb6-2eac-43f6-86cb-6bb5c6b3c143 tempest-GroupSnapshotsTest-1856318917 None] Update group completed successfully. Nov 03 13:14:12 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4e3968f7-b1a7-4926-bb80-ba52a3194b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.432s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:12 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-4e3968f7-b1a7-4926-bb80-ba52a3194b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:14:12 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-4e3968f7-b1a7-4926-bb80-ba52a3194b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Deleted volume successfully. Nov 03 13:14:12 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4e3968f7-b1a7-4926-bb80-ba52a3194b47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1326315658 None] Lock "cinder-a904531d-1470-4ab4-9dd9-cac8cf73cd35-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:13 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-3e1ebad5-492c-4203-867c-95314c8739e2 tempest-GroupSnapshotsTest-1856318917 None] Update group completed successfully. Nov 03 13:14:15 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-a99c7518-3bec-417f-880c-83f338fba769 tempest-GroupSnapshotsTest-1856318917 None] Update group completed successfully. Nov 03 13:14:16 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-ad952b3d-135b-4395-8f09-a416ee03dd97 tempest-GroupSnapshotsTest-1856318917 None] Update group completed successfully. Nov 03 13:14:17 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] GroupSnapshot 8d4097bb-d0db-49a0-bdc1-3f1b96de5b9c: creating. Nov 03 13:14:18 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] Group snapshot 8d4097bb-d0db-49a0-bdc1-3f1b96de5b9c: creating. {{(pid=86725) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 13:14:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:18 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] Creating offline snapshot 1ec244ca-b414-4a63-a5d0-be47017a3b88 of volume 0e74d797-ed12-4a83-9967-9a012f1530fc {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:14:18 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9235af-5b6b-48dd-9e87-ca9d1fc0f09c]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:18 devstack sudo[96994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc Nov 03 13:14:18 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:18 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc" returned: 0 in 0.487s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc.1ec244ca-b414-4a63-a5d0-be47017a3b88 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:18 devstack sudo[96999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc.1ec244ca-b414-4a63-a5d0-be47017a3b88 1G Nov 03 13:14:18 devstack sudo[96999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:19 devstack sudo[96999]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc.1ec244ca-b414-4a63-a5d0-be47017a3b88 1G" returned: 0 in 0.644s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e74d797-ed12-4a83-9967-9a012f1530fc -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc.1ec244ca-b414-4a63-a5d0-be47017a3b88 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:19 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e74d797-ed12-4a83-9967-9a012f1530fc -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc.1ec244ca-b414-4a63-a5d0-be47017a3b88 Nov 03 13:14:19 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:19 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e74d797-ed12-4a83-9967-9a012f1530fc -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc.1ec244ca-b414-4a63-a5d0-be47017a3b88" returned: 0 in 0.334s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:19 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc.1ec244ca-b414-4a63-a5d0-be47017a3b88 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 13:14:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc.1ec244ca-b414-4a63-a5d0-be47017a3b88 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:19 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc.1ec244ca-b414-4a63-a5d0-be47017a3b88 Nov 03 13:14:19 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:19 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc.1ec244ca-b414-4a63-a5d0-be47017a3b88" returned: 0 in 0.292s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:19 devstack sudo[97015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc.info Nov 03 13:14:19 devstack sudo[97015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:20 devstack sudo[97015]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc.info" returned: 0 in 0.315s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:20 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 13:14:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:20 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc.info Nov 03 13:14:20 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:20 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc.info" returned: 0 in 0.309s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.521s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:20 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] Creating offline snapshot 32db6cc4-b072-49cf-bd62-47f3dd890ba7 of volume be088a30-fdf4-43f3-bbee-50d5afd6e9fa {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:14:20 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[d840fb89-01fb-44b1-82c2-8315134c63e9]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:20 devstack sudo[97021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa Nov 03 13:14:20 devstack sudo[97021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:21 devstack sudo[97021]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa" returned: 0 in 0.611s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa.32db6cc4-b072-49cf-bd62-47f3dd890ba7 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:21 devstack sudo[97027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa.32db6cc4-b072-49cf-bd62-47f3dd890ba7 1G Nov 03 13:14:21 devstack sudo[97027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:21 devstack sudo[97027]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa.32db6cc4-b072-49cf-bd62-47f3dd890ba7 1G" returned: 0 in 0.690s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa.32db6cc4-b072-49cf-bd62-47f3dd890ba7 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:21 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa.32db6cc4-b072-49cf-bd62-47f3dd890ba7 Nov 03 13:14:21 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:22 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa.32db6cc4-b072-49cf-bd62-47f3dd890ba7" returned: 0 in 0.480s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:22 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa.32db6cc4-b072-49cf-bd62-47f3dd890ba7 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 13:14:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa.32db6cc4-b072-49cf-bd62-47f3dd890ba7 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:22 devstack sudo[97040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa.32db6cc4-b072-49cf-bd62-47f3dd890ba7 Nov 03 13:14:22 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:22 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa.32db6cc4-b072-49cf-bd62-47f3dd890ba7" returned: 0 in 0.354s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:22 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa.info Nov 03 13:14:22 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:23 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa.info" returned: 0 in 0.348s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:23 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 13:14:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:23 devstack sudo[97046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa.info Nov 03 13:14:23 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:23 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa.info" returned: 0 in 0.317s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.938s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:23 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-c8ac0aa7-a2eb-48ee-892f-efe1cccbc301 tempest-GroupSnapshotsTest-1856318917 None] group_snapshot 8d4097bb-d0db-49a0-bdc1-3f1b96de5b9c: created successfully Nov 03 13:14:24 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] group_snapshot 8d4097bb-d0db-49a0-bdc1-3f1b96de5b9c: deleting Nov 03 13:14:24 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=140,cinder:INSERT=34,cinder:UPDATE=151,cinder:DELETE=9 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:14:24 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:INSERT=47,cinder:UPDATE=144,cinder:DELETE=10,cinder:SELECT=125 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:14:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] group_snapshot 8d4097bb-d0db-49a0-bdc1-3f1b96de5b9c: deleting {{(pid=86725) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 13:14:24 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] Acquiring lock "cinder-quobyte-0e74d797-ed12-4a83-9967-9a012f1530fc" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:24 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] Lock "cinder-quobyte-0e74d797-ed12-4a83-9967-9a012f1530fc" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:24 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] Acquiring lock "cinder-quobyte-1ec244ca-b414-4a63-a5d0-be47017a3b88" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:24 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] Lock "cinder-quobyte-1ec244ca-b414-4a63-a5d0-be47017a3b88" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:24 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] Deleting offline snapshot 1ec244ca-b414-4a63-a5d0-be47017a3b88 of volume 0e74d797-ed12-4a83-9967-9a012f1530fc {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:14:24 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] snapshot_file for this snap is: volume-0e74d797-ed12-4a83-9967-9a012f1530fc.1ec244ca-b414-4a63-a5d0-be47017a3b88 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:14:24 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dbc83f-5361-4c65-95f2-45964972b0c7]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc.1ec244ca-b414-4a63-a5d0-be47017a3b88 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:25 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc.1ec244ca-b414-4a63-a5d0-be47017a3b88 Nov 03 13:14:25 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:25 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc.1ec244ca-b414-4a63-a5d0-be47017a3b88" returned: 0 in 0.728s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e74d797-ed12-4a83-9967-9a012f1530fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:14:25 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c01b25-ef31-4239-b949-7c915b485539]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:25 devstack sudo[97062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc Nov 03 13:14:25 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:26 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc" returned: 0 in 0.528s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc.1ec244ca-b414-4a63-a5d0-be47017a3b88 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:26 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc.1ec244ca-b414-4a63-a5d0-be47017a3b88 Nov 03 13:14:26 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:26 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc.1ec244ca-b414-4a63-a5d0-be47017a3b88" returned: 0 in 0.512s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc.1ec244ca-b414-4a63-a5d0-be47017a3b88 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:26 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc.1ec244ca-b414-4a63-a5d0-be47017a3b88 Nov 03 13:14:26 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:27 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc.1ec244ca-b414-4a63-a5d0-be47017a3b88" returned: 0 in 0.287s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:27 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] Lock "cinder-quobyte-1ec244ca-b414-4a63-a5d0-be47017a3b88" released by "_delete_snapshot" :: held 2.243s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:27 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] Lock "cinder-quobyte-0e74d797-ed12-4a83-9967-9a012f1530fc" released by "delete_snapshot" :: held 2.283s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:27 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] Acquiring lock "cinder-quobyte-be088a30-fdf4-43f3-bbee-50d5afd6e9fa" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:27 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] Lock "cinder-quobyte-be088a30-fdf4-43f3-bbee-50d5afd6e9fa" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:27 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] Acquiring lock "cinder-quobyte-32db6cc4-b072-49cf-bd62-47f3dd890ba7" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:27 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] Lock "cinder-quobyte-32db6cc4-b072-49cf-bd62-47f3dd890ba7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:27 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] Deleting offline snapshot 32db6cc4-b072-49cf-bd62-47f3dd890ba7 of volume be088a30-fdf4-43f3-bbee-50d5afd6e9fa {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:14:27 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] snapshot_file for this snap is: volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa.32db6cc4-b072-49cf-bd62-47f3dd890ba7 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:14:27 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fed1ec9-405a-43ab-9ac4-6e69c77bd6fe]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa.32db6cc4-b072-49cf-bd62-47f3dd890ba7 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:27 devstack sudo[97089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa.32db6cc4-b072-49cf-bd62-47f3dd890ba7 Nov 03 13:14:27 devstack sudo[97089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:27 devstack sudo[97089]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa.32db6cc4-b072-49cf-bd62-47f3dd890ba7" returned: 0 in 0.434s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:27 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:14:27 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0354c2-f41e-42e9-9385-3dc496646f94]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:27 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa Nov 03 13:14:27 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:28 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa" returned: 0 in 0.440s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa.32db6cc4-b072-49cf-bd62-47f3dd890ba7 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:28 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa.32db6cc4-b072-49cf-bd62-47f3dd890ba7 Nov 03 13:14:28 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:28 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa.32db6cc4-b072-49cf-bd62-47f3dd890ba7" returned: 0 in 0.422s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa.32db6cc4-b072-49cf-bd62-47f3dd890ba7 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:28 devstack sudo[97106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa.32db6cc4-b072-49cf-bd62-47f3dd890ba7 Nov 03 13:14:28 devstack sudo[97106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:28 devstack sudo[97106]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa.32db6cc4-b072-49cf-bd62-47f3dd890ba7" returned: 0 in 0.281s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:28 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] Lock "cinder-quobyte-32db6cc4-b072-49cf-bd62-47f3dd890ba7" released by "_delete_snapshot" :: held 1.714s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:28 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] Lock "cinder-quobyte-be088a30-fdf4-43f3-bbee-50d5afd6e9fa" released by "delete_snapshot" :: held 1.742s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:28 devstack cinder-volume[86725]: WARNING cinder.quota [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1396503413 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1396503413, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:14:28 devstack cinder-volume[86725]: WARNING cinder.quota [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1396503413 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1396503413, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:14:28 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] Created reservations ['07e380a2-663f-4e67-9e3b-61fc61f80ebd', '201a48c1-8f0f-46b7-82ab-73394ae5bdd6', 'd0d889d7-7139-4bda-ac9c-905d982d746a', 'b6df38d8-8ac7-4a22-99e5-9db3cfa3f48e'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:29 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] Created reservations ['836ea734-355e-421d-acc9-aa6a31623555', '5208fe4f-0294-4eda-91bf-b45bb7a10e78', '34e197fd-0ceb-431c-b8ed-8500a3423583', '9ec8a037-8700-42dd-aaa1-44241fea04b6'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:29 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-785d59bd-a816-4916-aabe-045a9b068e6b tempest-GroupSnapshotsTest-1856318917 None] group_snapshot 8d4097bb-d0db-49a0-bdc1-3f1b96de5b9c: deleted successfully Nov 03 13:14:30 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0bb18ce7-5894-4a61-810f-dbecd05a2a7a tempest-GroupSnapshotsTest-1856318917 None] Acquiring lock "cinder-quobyte-0e74d797-ed12-4a83-9967-9a012f1530fc" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:30 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0bb18ce7-5894-4a61-810f-dbecd05a2a7a tempest-GroupSnapshotsTest-1856318917 None] Lock "cinder-quobyte-0e74d797-ed12-4a83-9967-9a012f1530fc" acquired by "delete_volume" :: waited 0.049s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:30 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[6773aeee-88c4-4202-8825-2649b58a8700]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0bb18ce7-5894-4a61-810f-dbecd05a2a7a tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:30 devstack sudo[97126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc Nov 03 13:14:30 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:31 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0bb18ce7-5894-4a61-810f-dbecd05a2a7a tempest-GroupSnapshotsTest-1856318917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc" returned: 0 in 0.796s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0bb18ce7-5894-4a61-810f-dbecd05a2a7a tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:31 devstack sudo[97171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc Nov 03 13:14:31 devstack sudo[97171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:31 devstack sudo[97171]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0bb18ce7-5894-4a61-810f-dbecd05a2a7a tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0e74d797-ed12-4a83-9967-9a012f1530fc" returned: 0 in 0.694s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:31 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0bb18ce7-5894-4a61-810f-dbecd05a2a7a tempest-GroupSnapshotsTest-1856318917 None] Lock "cinder-quobyte-0e74d797-ed12-4a83-9967-9a012f1530fc" released by "delete_volume" :: held 1.674s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:31 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0bb18ce7-5894-4a61-810f-dbecd05a2a7a tempest-GroupSnapshotsTest-1856318917 None] Acquiring lock "cinder-quobyte-be088a30-fdf4-43f3-bbee-50d5afd6e9fa" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:31 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0bb18ce7-5894-4a61-810f-dbecd05a2a7a tempest-GroupSnapshotsTest-1856318917 None] Lock "cinder-quobyte-be088a30-fdf4-43f3-bbee-50d5afd6e9fa" acquired by "delete_volume" :: waited 0.040s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:32 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[7540b65a-e3d4-4b51-943f-7b2dbee9ef09]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0bb18ce7-5894-4a61-810f-dbecd05a2a7a tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:32 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa Nov 03 13:14:32 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:32 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:14:32 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] Flow 'volume_create_manager' (e834b41b-f289-45e5-a295-453500669015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:32 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcadf631-0287-4fef-9cdf-63a1efef300d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:32 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcadf631-0287-4fef-9cdf-63a1efef300d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-899333780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=817caf8e-63de-40aa-bab6-3b5451ed0423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f7772490b614805b084fa70f6a02200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:32Z,use_quota=True,user_id='92a7e66c78fb49f49db1ab97eefb10d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:32 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515a263a-339c-407c-8a7d-77f1a5a422fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:32 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515a263a-339c-407c-8a7d-77f1a5a422fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:32 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa66f84d-d883-4fb1-b286-902d6bcfa9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:32 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa66f84d-d883-4fb1-b286-902d6bcfa9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '817caf8e-63de-40aa-bab6-3b5451ed0423', 'volume_name': 'volume-817caf8e-63de-40aa-bab6-3b5451ed0423', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:32 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ced77d0-f45a-4d0b-b501-eb77e55cb937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:32 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ced77d0-f45a-4d0b-b501-eb77e55cb937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:32 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (599e2813-6857-4dad-9a79-70f8d33999fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:32 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] Volume 817caf8e-63de-40aa-bab6-3b5451ed0423: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-817caf8e-63de-40aa-bab6-3b5451ed0423', 'volume_size': 1} Nov 03 13:14:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:32 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-899333780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=817caf8e-63de-40aa-bab6-3b5451ed0423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f7772490b614805b084fa70f6a02200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:32Z,use_quota=True,user_id='92a7e66c78fb49f49db1ab97eefb10d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:14:32 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] Creating volume 817caf8e-63de-40aa-bab6-3b5451ed0423 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:14:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:32 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:32 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:32 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:14:32 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:14:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:32 devstack sudo[97188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423 1073741824 Nov 03 13:14:32 devstack sudo[97188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:33 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0bb18ce7-5894-4a61-810f-dbecd05a2a7a tempest-GroupSnapshotsTest-1856318917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa" returned: 0 in 0.900s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0bb18ce7-5894-4a61-810f-dbecd05a2a7a tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:33 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa Nov 03 13:14:33 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:33 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:33 devstack sudo[97188]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0bb18ce7-5894-4a61-810f-dbecd05a2a7a tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-be088a30-fdf4-43f3-bbee-50d5afd6e9fa" returned: 0 in 0.593s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423 1073741824" returned: 0 in 0.980s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:33 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0bb18ce7-5894-4a61-810f-dbecd05a2a7a tempest-GroupSnapshotsTest-1856318917 None] Lock "cinder-quobyte-be088a30-fdf4-43f3-bbee-50d5afd6e9fa" released by "delete_volume" :: held 1.696s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:33 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423 Nov 03 13:14:33 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:33 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-0bb18ce7-5894-4a61-810f-dbecd05a2a7a tempest-GroupSnapshotsTest-1856318917 None] Created reservations ['b0b9464a-c6fb-4721-8d2f-9f3183046d67'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:33 devstack cinder-volume[86725]: WARNING cinder.quota [None req-0bb18ce7-5894-4a61-810f-dbecd05a2a7a tempest-GroupSnapshotsTest-1856318917 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1396503413 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1396503413, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:14:34 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-0bb18ce7-5894-4a61-810f-dbecd05a2a7a tempest-GroupSnapshotsTest-1856318917 None] Created reservations ['2ad4a170-f550-46b9-a6bc-1280d88c963d', 'b7195506-11a0-4a14-877a-7958985b8dee', '43396927-e3b0-4365-abfd-88aead820db4', '3ac82127-e86a-4efc-88c9-d6db8d536fe8'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:34 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-0bb18ce7-5894-4a61-810f-dbecd05a2a7a tempest-GroupSnapshotsTest-1856318917 None] Created reservations ['44d9fecc-cd43-4f8d-9dce-45e3793922c6', 'e1bf1642-a5f3-4dbf-8977-bbdd244e8833', 'bf8508ea-b616-48b7-bb60-bf9c74d6bc0e', 'd38999e4-2545-46fe-a717-ef5e966279f6'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:34 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423" returned: 0 in 0.487s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:34 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:14:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (599e2813-6857-4dad-9a79-70f8d33999fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-817caf8e-63de-40aa-bab6-3b5451ed0423', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89dbf857-49d7-4916-8b58-db480237a7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:34 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] Volume volume-817caf8e-63de-40aa-bab6-3b5451ed0423 (817caf8e-63de-40aa-bab6-3b5451ed0423): created successfully Nov 03 13:14:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89dbf857-49d7-4916-8b58-db480237a7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] Flow 'volume_create_manager' (e834b41b-f289-45e5-a295-453500669015) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:34 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-d223105f-b77d-43c9-87a2-3fc24983ad02 tempest-VolumesSnapshotTestJSON-776558485 None] Created volume successfully. Nov 03 13:14:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0bb18ce7-5894-4a61-810f-dbecd05a2a7a tempest-GroupSnapshotsTest-1856318917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0bb18ce7-5894-4a61-810f-dbecd05a2a7a tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:34 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0bb18ce7-5894-4a61-810f-dbecd05a2a7a tempest-GroupSnapshotsTest-1856318917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:34 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0bb18ce7-5894-4a61-810f-dbecd05a2a7a tempest-GroupSnapshotsTest-1856318917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0bb18ce7-5894-4a61-810f-dbecd05a2a7a tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0bb18ce7-5894-4a61-810f-dbecd05a2a7a tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:34 devstack sudo[97204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:14:34 devstack sudo[97204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:34 devstack sudo[97204]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0bb18ce7-5894-4a61-810f-dbecd05a2a7a tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.393s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:34 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-0bb18ce7-5894-4a61-810f-dbecd05a2a7a tempest-GroupSnapshotsTest-1856318917 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:14:34 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-0bb18ce7-5894-4a61-810f-dbecd05a2a7a tempest-GroupSnapshotsTest-1856318917 None] Delete group completed successfully. Nov 03 13:14:35 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-254f7a56-536f-4780-b724-d8d93bc5114c tempest-GroupSnapshotsTest-1856318917 None] Group tempest-GroupSnapshotsTest-Group-670147001: creating Nov 03 13:14:35 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-254f7a56-536f-4780-b724-d8d93bc5114c tempest-GroupSnapshotsTest-1856318917 None] Group tempest-GroupSnapshotsTest-Group-670147001: created successfully Nov 03 13:14:35 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-254f7a56-536f-4780-b724-d8d93bc5114c tempest-GroupSnapshotsTest-1856318917 None] Create group completed successfully. Nov 03 13:14:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e5188a66-cf66-457f-a07c-796ec7e5fdd5 tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e5188a66-cf66-457f-a07c-796ec7e5fdd5 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-e5188a66-cf66-457f-a07c-796ec7e5fdd5 tempest-VolumesSnapshotTestJSON-776558485 None] Creating offline snapshot ac7b01a9-161c-4cac-94c9-67c3012199a9 of volume 817caf8e-63de-40aa-bab6-3b5451ed0423 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:14:36 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca82a9f-3c97-4673-abe2-e98697421e3e]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e5188a66-cf66-457f-a07c-796ec7e5fdd5 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:36 devstack sudo[97210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423 Nov 03 13:14:36 devstack sudo[97210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:36 devstack sudo[97210]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e5188a66-cf66-457f-a07c-796ec7e5fdd5 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423" returned: 0 in 0.519s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e5188a66-cf66-457f-a07c-796ec7e5fdd5 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423.ac7b01a9-161c-4cac-94c9-67c3012199a9 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:36 devstack sudo[97216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423.ac7b01a9-161c-4cac-94c9-67c3012199a9 1G Nov 03 13:14:36 devstack sudo[97216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:37 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:14:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] Flow 'volume_create_manager' (3b7f19a7-0017-4ace-827f-6374c69bbbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (717a92b1-c670-4297-93b9-280cd36fbcb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:37 devstack sudo[97216]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (717a92b1-c670-4297-93b9-280cd36fbcb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-21465897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0991c043-8da7-4ec4-aa71-268590cc9833,host='devstack@QuobyteHD#QuobyteHD',id=8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64ad2c04c3064b0cb6e157c387cb14e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:37Z,use_quota=True,user_id='5dcd966f7a8541568b9f73e8f8174231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd8f55c4-4ab8-4cb6-99a6-30cb1d272941),volume_type_id=cd8f55c4-4ab8-4cb6-99a6-30cb1d272941)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (491702c6-fb49-4fde-b8fc-a5e31977edff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (491702c6-fb49-4fde-b8fc-a5e31977edff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b92ad2-6e07-4e80-9831-8fe618a1bcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b92ad2-6e07-4e80-9831-8fe618a1bcac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd', 'volume_name': 'volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c8f3c7-bfff-4dbe-9b10-8bb173273e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c8f3c7-bfff-4dbe-9b10-8bb173273e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00a3e711-37a9-4621-8255-445f37d4d152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:37 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] Volume 8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd', 'volume_size': 1} Nov 03 13:14:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e5188a66-cf66-457f-a07c-796ec7e5fdd5 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423.ac7b01a9-161c-4cac-94c9-67c3012199a9 1G" returned: 0 in 0.610s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e5188a66-cf66-457f-a07c-796ec7e5fdd5 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-817caf8e-63de-40aa-bab6-3b5451ed0423 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423.ac7b01a9-161c-4cac-94c9-67c3012199a9 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:37 devstack sudo[97221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-817caf8e-63de-40aa-bab6-3b5451ed0423 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423.ac7b01a9-161c-4cac-94c9-67c3012199a9 Nov 03 13:14:37 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:37 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e5188a66-cf66-457f-a07c-796ec7e5fdd5 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-817caf8e-63de-40aa-bab6-3b5451ed0423 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423.ac7b01a9-161c-4cac-94c9-67c3012199a9" returned: 0 in 0.313s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:37 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-e5188a66-cf66-457f-a07c-796ec7e5fdd5 tempest-VolumesSnapshotTestJSON-776558485 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423.ac7b01a9-161c-4cac-94c9-67c3012199a9 is being set with open permissions: ugo+rw Nov 03 13:14:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e5188a66-cf66-457f-a07c-796ec7e5fdd5 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423.ac7b01a9-161c-4cac-94c9-67c3012199a9 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:37 devstack sudo[97226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423.ac7b01a9-161c-4cac-94c9-67c3012199a9 Nov 03 13:14:37 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:37 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e5188a66-cf66-457f-a07c-796ec7e5fdd5 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423.ac7b01a9-161c-4cac-94c9-67c3012199a9" returned: 0 in 0.271s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e5188a66-cf66-457f-a07c-796ec7e5fdd5 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:37 devstack sudo[97229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423.info Nov 03 13:14:37 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:38 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e5188a66-cf66-457f-a07c-796ec7e5fdd5 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423.info" returned: 0 in 0.313s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:38 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-e5188a66-cf66-457f-a07c-796ec7e5fdd5 tempest-VolumesSnapshotTestJSON-776558485 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423.info is being set with open permissions: ugo+rw Nov 03 13:14:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e5188a66-cf66-457f-a07c-796ec7e5fdd5 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:38 devstack sudo[97232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423.info Nov 03 13:14:38 devstack sudo[97232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:38 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:14:38 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] Flow 'volume_create_manager' (02d08e0d-7a23-4dfa-883e-638c98357902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:38 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2997b79b-4a4a-46f5-8d5e-ab5b120f1b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:38 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2997b79b-4a4a-46f5-8d5e-ab5b120f1b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1639629775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adc839e9-8b6d-4932-935f-2937471edf86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d9f53903834773af191a671fc53375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:38Z,use_quota=True,user_id='7ead0b770b7a4a7ca46c3450f8aca4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:38 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d258511-ff0b-4f83-8b21-273e78b2c339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:38 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d258511-ff0b-4f83-8b21-273e78b2c339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:38 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (427c631a-e44a-4972-ba7d-985279426049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:38 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (427c631a-e44a-4972-ba7d-985279426049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adc839e9-8b6d-4932-935f-2937471edf86', 'volume_name': 'volume-adc839e9-8b6d-4932-935f-2937471edf86', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:38 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89946310-6145-444c-9895-88f920b208a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:38 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89946310-6145-444c-9895-88f920b208a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:38 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e0c39c2-8a53-4805-bb66-1195837fd5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:38 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] Volume adc839e9-8b6d-4932-935f-2937471edf86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adc839e9-8b6d-4932-935f-2937471edf86', 'volume_size': 1} Nov 03 13:14:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:38 devstack sudo[97232]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e5188a66-cf66-457f-a07c-796ec7e5fdd5 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423.info" returned: 0 in 0.271s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e5188a66-cf66-457f-a07c-796ec7e5fdd5 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.415s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.234s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:38 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0991c043-8da7-4ec4-aa71-268590cc9833,created_at=2026-11-03T12:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-21465897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0991c043-8da7-4ec4-aa71-268590cc9833,host='devstack@QuobyteHD#QuobyteHD',id=8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64ad2c04c3064b0cb6e157c387cb14e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:37Z,use_quota=True,user_id='5dcd966f7a8541568b9f73e8f8174231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd8f55c4-4ab8-4cb6-99a6-30cb1d272941),volume_type_id=cd8f55c4-4ab8-4cb6-99a6-30cb1d272941)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:14:38 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] Creating volume 8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:14:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:38 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:38 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:38 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:14:38 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:14:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:38 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd 1073741824 Nov 03 13:14:38 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:38 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-e5188a66-cf66-457f-a07c-796ec7e5fdd5 tempest-VolumesSnapshotTestJSON-776558485 None] Create snapshot completed successfully Nov 03 13:14:38 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd 1073741824" returned: 0 in 0.412s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:39 devstack sudo[97240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd Nov 03 13:14:39 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:39 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd" returned: 0 in 0.283s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:39 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:14:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.881s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:39 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1639629775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adc839e9-8b6d-4932-935f-2937471edf86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d9f53903834773af191a671fc53375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:38Z,use_quota=True,user_id='7ead0b770b7a4a7ca46c3450f8aca4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:14:39 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] Creating volume adc839e9-8b6d-4932-935f-2937471edf86 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:14:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:39 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:39 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:39 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:14:39 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:14:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-adc839e9-8b6d-4932-935f-2937471edf86 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:39 devstack sudo[97243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-adc839e9-8b6d-4932-935f-2937471edf86 1073741824 Nov 03 13:14:39 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:39 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00a3e711-37a9-4621-8255-445f37d4d152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:39 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae46148-4257-4b86-9968-3cc604bfb2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:39 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] Volume volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd (8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd): created successfully Nov 03 13:14:39 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae46148-4257-4b86-9968-3cc604bfb2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:39 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] Flow 'volume_create_manager' (3b7f19a7-0017-4ace-827f-6374c69bbbd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:39 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-cc8a3d5a-6a7b-492c-8fc8-d12cd864f29f tempest-GroupSnapshotsTest-1856318917 None] Created volume successfully. Nov 03 13:14:39 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-7fff3d26-ec32-443a-890f-4a4fcd476c1b tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "cinder-ac7b01a9-161c-4cac-94c9-67c3012199a9-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:39 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-7fff3d26-ec32-443a-890f-4a4fcd476c1b tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-ac7b01a9-161c-4cac-94c9-67c3012199a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:39 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-7fff3d26-ec32-443a-890f-4a4fcd476c1b tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "cinder-quobyte-817caf8e-63de-40aa-bab6-3b5451ed0423" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:39 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-7fff3d26-ec32-443a-890f-4a4fcd476c1b tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-quobyte-817caf8e-63de-40aa-bab6-3b5451ed0423" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:39 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-7fff3d26-ec32-443a-890f-4a4fcd476c1b tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "cinder-quobyte-ac7b01a9-161c-4cac-94c9-67c3012199a9" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:39 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-7fff3d26-ec32-443a-890f-4a4fcd476c1b tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-quobyte-ac7b01a9-161c-4cac-94c9-67c3012199a9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:39 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-7fff3d26-ec32-443a-890f-4a4fcd476c1b tempest-VolumesSnapshotTestJSON-776558485 None] Deleting offline snapshot ac7b01a9-161c-4cac-94c9-67c3012199a9 of volume 817caf8e-63de-40aa-bab6-3b5451ed0423 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:14:39 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-7fff3d26-ec32-443a-890f-4a4fcd476c1b tempest-VolumesSnapshotTestJSON-776558485 None] snapshot_file for this snap is: volume-817caf8e-63de-40aa-bab6-3b5451ed0423.ac7b01a9-161c-4cac-94c9-67c3012199a9 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:14:39 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[23305947-2199-4677-b129-ed416cad2177]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7fff3d26-ec32-443a-890f-4a4fcd476c1b tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423.ac7b01a9-161c-4cac-94c9-67c3012199a9 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:39 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:39 devstack sudo[97248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423.ac7b01a9-161c-4cac-94c9-67c3012199a9 Nov 03 13:14:39 devstack sudo[97248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-adc839e9-8b6d-4932-935f-2937471edf86 1073741824" returned: 0 in 0.507s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-adc839e9-8b6d-4932-935f-2937471edf86 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:39 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-adc839e9-8b6d-4932-935f-2937471edf86 Nov 03 13:14:39 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:40 devstack sudo[97248]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7fff3d26-ec32-443a-890f-4a4fcd476c1b tempest-VolumesSnapshotTestJSON-776558485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423.ac7b01a9-161c-4cac-94c9-67c3012199a9" returned: 0 in 0.427s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:40 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-7fff3d26-ec32-443a-890f-4a4fcd476c1b tempest-VolumesSnapshotTestJSON-776558485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-817caf8e-63de-40aa-bab6-3b5451ed0423(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:14:40 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[56afba5d-934f-4987-a0d0-0146932a1954]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:40 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7fff3d26-ec32-443a-890f-4a4fcd476c1b tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-adc839e9-8b6d-4932-935f-2937471edf86" returned: 0 in 0.306s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:40 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:14:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:40 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e0c39c2-8a53-4805-bb66-1195837fd5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adc839e9-8b6d-4932-935f-2937471edf86', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:40 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58310a02-8df5-4ccb-b2a6-98f0a77ab0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:40 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] Volume volume-adc839e9-8b6d-4932-935f-2937471edf86 (adc839e9-8b6d-4932-935f-2937471edf86): created successfully Nov 03 13:14:40 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58310a02-8df5-4ccb-b2a6-98f0a77ab0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:40 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] Flow 'volume_create_manager' (02d08e0d-7a23-4dfa-883e-638c98357902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:40 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-76b58539-bfdf-49fa-a9dc-ae983a8b2a56 tempest-VolumesTransfersTest-732065756 None] Created volume successfully. Nov 03 13:14:40 devstack sudo[97258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423 Nov 03 13:14:40 devstack sudo[97258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:40 devstack sudo[97258]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7fff3d26-ec32-443a-890f-4a4fcd476c1b tempest-VolumesSnapshotTestJSON-776558485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423" returned: 0 in 0.460s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7fff3d26-ec32-443a-890f-4a4fcd476c1b tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423.ac7b01a9-161c-4cac-94c9-67c3012199a9 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:40 devstack sudo[97263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423.ac7b01a9-161c-4cac-94c9-67c3012199a9 Nov 03 13:14:40 devstack sudo[97263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:41 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-03b82d3a-b8af-4399-9075-68fd5cbc6286 tempest-GroupSnapshotsTest-1856318917 None] GroupSnapshot 45ccfe43-43f7-4abf-b7f7-1d69c7a3ccbb: creating. Nov 03 13:14:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-03b82d3a-b8af-4399-9075-68fd5cbc6286 tempest-GroupSnapshotsTest-1856318917 None] Group snapshot 45ccfe43-43f7-4abf-b7f7-1d69c7a3ccbb: creating. {{(pid=86725) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 13:14:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-03b82d3a-b8af-4399-9075-68fd5cbc6286 tempest-GroupSnapshotsTest-1856318917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-03b82d3a-b8af-4399-9075-68fd5cbc6286 tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:41 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-03b82d3a-b8af-4399-9075-68fd5cbc6286 tempest-GroupSnapshotsTest-1856318917 None] Creating offline snapshot fd79ae64-f7f8-4ffd-905c-2bb9d5e90397 of volume 8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:14:41 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[7725cf02-7225-4192-9a52-56fd10f191eb]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-03b82d3a-b8af-4399-9075-68fd5cbc6286 tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:41 devstack sudo[97263]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7fff3d26-ec32-443a-890f-4a4fcd476c1b tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423.ac7b01a9-161c-4cac-94c9-67c3012199a9" returned: 0 in 0.577s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7fff3d26-ec32-443a-890f-4a4fcd476c1b tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423.ac7b01a9-161c-4cac-94c9-67c3012199a9 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:41 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423.ac7b01a9-161c-4cac-94c9-67c3012199a9 Nov 03 13:14:41 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:41 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-cb4bceb1-52c0-43e9-8118-195f48954f11 tempest-VolumesTransfersTest-1471004032 None] Transfer volume completed successfully. Nov 03 13:14:41 devstack sudo[97269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd Nov 03 13:14:41 devstack sudo[97269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:41 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7fff3d26-ec32-443a-890f-4a4fcd476c1b tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423.ac7b01a9-161c-4cac-94c9-67c3012199a9" returned: 0 in 0.335s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:41 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-7fff3d26-ec32-443a-890f-4a4fcd476c1b tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-quobyte-ac7b01a9-161c-4cac-94c9-67c3012199a9" released by "_delete_snapshot" :: held 1.933s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:41 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-7fff3d26-ec32-443a-890f-4a4fcd476c1b tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-quobyte-817caf8e-63de-40aa-bab6-3b5451ed0423" released by "delete_snapshot" :: held 1.967s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:41 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-7fff3d26-ec32-443a-890f-4a4fcd476c1b tempest-VolumesSnapshotTestJSON-776558485 None] Created reservations ['c85dcc9e-fc9a-47bf-b339-438deda10a33', 'ed5370dd-9d15-4a20-833c-d982bbacc83a', 'aff17a9e-4e3e-4305-a394-296c485fea65', '1f0f941e-5ee9-49bb-93ad-49f56a72b285'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:41 devstack sudo[97269]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-03b82d3a-b8af-4399-9075-68fd5cbc6286 tempest-GroupSnapshotsTest-1856318917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd" returned: 0 in 0.566s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-03b82d3a-b8af-4399-9075-68fd5cbc6286 tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd.fd79ae64-f7f8-4ffd-905c-2bb9d5e90397 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:41 devstack sudo[97277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd.fd79ae64-f7f8-4ffd-905c-2bb9d5e90397 1G Nov 03 13:14:41 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:41 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-7fff3d26-ec32-443a-890f-4a4fcd476c1b tempest-VolumesSnapshotTestJSON-776558485 None] Delete snapshot completed successfully. Nov 03 13:14:41 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-7fff3d26-ec32-443a-890f-4a4fcd476c1b tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-ac7b01a9-161c-4cac-94c9-67c3012199a9-delete_snapshot" released by "delete_snapshot" :: held 2.255s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:42 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-768eb17f-46a7-454e-86f1-77394d62ca55 tempest-VolumesTransfersTest-1120855229 None] Acquiring lock "cinder-adc839e9-8b6d-4932-935f-2937471edf86-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:42 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-768eb17f-46a7-454e-86f1-77394d62ca55 tempest-VolumesTransfersTest-1120855229 None] Lock "cinder-adc839e9-8b6d-4932-935f-2937471edf86-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:42 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-768eb17f-46a7-454e-86f1-77394d62ca55 tempest-VolumesTransfersTest-1120855229 None] Acquiring lock "cinder-quobyte-adc839e9-8b6d-4932-935f-2937471edf86" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:42 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-768eb17f-46a7-454e-86f1-77394d62ca55 tempest-VolumesTransfersTest-1120855229 None] Lock "cinder-quobyte-adc839e9-8b6d-4932-935f-2937471edf86" acquired by "delete_volume" :: waited 0.024s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:42 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5df4be-8524-44f2-8a97-3aff42825854]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-768eb17f-46a7-454e-86f1-77394d62ca55 tempest-VolumesTransfersTest-1120855229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-adc839e9-8b6d-4932-935f-2937471edf86 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:42 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-03b82d3a-b8af-4399-9075-68fd5cbc6286 tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd.fd79ae64-f7f8-4ffd-905c-2bb9d5e90397 1G" returned: 0 in 0.630s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-03b82d3a-b8af-4399-9075-68fd5cbc6286 tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd.fd79ae64-f7f8-4ffd-905c-2bb9d5e90397 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:42 devstack sudo[97284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd.fd79ae64-f7f8-4ffd-905c-2bb9d5e90397 Nov 03 13:14:42 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:42 devstack sudo[97283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-adc839e9-8b6d-4932-935f-2937471edf86 Nov 03 13:14:42 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:42 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:14:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] Flow 'volume_create_manager' (db83ac51-d554-4fbb-8543-c8425540ffc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1061a591-e4fb-40cb-9145-d6c13bbb2be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1061a591-e4fb-40cb-9145-d6c13bbb2be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1025478817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8bf71de-17dd-485c-a750-811adc054d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f7772490b614805b084fa70f6a02200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:43Z,use_quota=True,user_id='92a7e66c78fb49f49db1ab97eefb10d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09dcfb9b-7a2d-42c7-8898-0341e3c60789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09dcfb9b-7a2d-42c7-8898-0341e3c60789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec064f1-02e2-4d49-9c16-ed9b48dd27e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec064f1-02e2-4d49-9c16-ed9b48dd27e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8bf71de-17dd-485c-a750-811adc054d8c', 'volume_name': 'volume-d8bf71de-17dd-485c-a750-811adc054d8c', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60dabbc5-c1bd-4cb3-b8e8-52a58a3a22fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60dabbc5-c1bd-4cb3-b8e8-52a58a3a22fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ab7e279-9600-4b6a-ae12-7a3c2b397caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:42 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] Volume d8bf71de-17dd-485c-a750-811adc054d8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8bf71de-17dd-485c-a750-811adc054d8c', 'volume_size': 1} Nov 03 13:14:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:42 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-03b82d3a-b8af-4399-9075-68fd5cbc6286 tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd.fd79ae64-f7f8-4ffd-905c-2bb9d5e90397" returned: 0 in 0.408s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:42 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-03b82d3a-b8af-4399-9075-68fd5cbc6286 tempest-GroupSnapshotsTest-1856318917 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd.fd79ae64-f7f8-4ffd-905c-2bb9d5e90397 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 13:14:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-03b82d3a-b8af-4399-9075-68fd5cbc6286 tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd.fd79ae64-f7f8-4ffd-905c-2bb9d5e90397 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:42 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-768eb17f-46a7-454e-86f1-77394d62ca55 tempest-VolumesTransfersTest-1120855229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-adc839e9-8b6d-4932-935f-2937471edf86" returned: 0 in 0.511s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-768eb17f-46a7-454e-86f1-77394d62ca55 tempest-VolumesTransfersTest-1120855229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-adc839e9-8b6d-4932-935f-2937471edf86 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:42 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd.fd79ae64-f7f8-4ffd-905c-2bb9d5e90397 Nov 03 13:14:42 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:42 devstack sudo[97296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-adc839e9-8b6d-4932-935f-2937471edf86 Nov 03 13:14:42 devstack sudo[97296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:43 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-03b82d3a-b8af-4399-9075-68fd5cbc6286 tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd.fd79ae64-f7f8-4ffd-905c-2bb9d5e90397" returned: 0 in 0.261s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:43 devstack sudo[97296]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-03b82d3a-b8af-4399-9075-68fd5cbc6286 tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-768eb17f-46a7-454e-86f1-77394d62ca55 tempest-VolumesTransfersTest-1120855229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-adc839e9-8b6d-4932-935f-2937471edf86" returned: 0 in 0.274s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:43 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd.info Nov 03 13:14:43 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-768eb17f-46a7-454e-86f1-77394d62ca55 tempest-VolumesTransfersTest-1120855229 None] Lock "cinder-quobyte-adc839e9-8b6d-4932-935f-2937471edf86" released by "delete_volume" :: held 0.851s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:43 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:43 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-768eb17f-46a7-454e-86f1-77394d62ca55 tempest-VolumesTransfersTest-1120855229 None] Created reservations ['867ef75c-d42a-4200-98c1-166bb08f6d2b', 'bd162d26-c863-45f3-8f92-cfbde5c336a5', 'b27e0364-6671-4240-9bad-9e685b9ea8e3', '698137c5-5524-4697-80d7-2044d92bcd75'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-768eb17f-46a7-454e-86f1-77394d62ca55 tempest-VolumesTransfersTest-1120855229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-768eb17f-46a7-454e-86f1-77394d62ca55 tempest-VolumesTransfersTest-1120855229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:43 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-768eb17f-46a7-454e-86f1-77394d62ca55 tempest-VolumesTransfersTest-1120855229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:43 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-768eb17f-46a7-454e-86f1-77394d62ca55 tempest-VolumesTransfersTest-1120855229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-768eb17f-46a7-454e-86f1-77394d62ca55 tempest-VolumesTransfersTest-1120855229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-768eb17f-46a7-454e-86f1-77394d62ca55 tempest-VolumesTransfersTest-1120855229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:43 devstack sudo[97302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:14:43 devstack sudo[97302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:43 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-03b82d3a-b8af-4399-9075-68fd5cbc6286 tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd.info" returned: 0 in 0.349s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:43 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-03b82d3a-b8af-4399-9075-68fd5cbc6286 tempest-GroupSnapshotsTest-1856318917 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 13:14:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-03b82d3a-b8af-4399-9075-68fd5cbc6286 tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:43 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd.info Nov 03 13:14:43 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:43 devstack sudo[97302]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-768eb17f-46a7-454e-86f1-77394d62ca55 tempest-VolumesTransfersTest-1120855229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.292s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:43 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-768eb17f-46a7-454e-86f1-77394d62ca55 tempest-VolumesTransfersTest-1120855229 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:14:43 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-768eb17f-46a7-454e-86f1-77394d62ca55 tempest-VolumesTransfersTest-1120855229 None] Deleted volume successfully. Nov 03 13:14:43 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-768eb17f-46a7-454e-86f1-77394d62ca55 tempest-VolumesTransfersTest-1120855229 None] Lock "cinder-adc839e9-8b6d-4932-935f-2937471edf86-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:43 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-03b82d3a-b8af-4399-9075-68fd5cbc6286 tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd.info" returned: 0 in 0.297s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-03b82d3a-b8af-4399-9075-68fd5cbc6286 tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.627s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.022s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:43 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1025478817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8bf71de-17dd-485c-a750-811adc054d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f7772490b614805b084fa70f6a02200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:43Z,use_quota=True,user_id='92a7e66c78fb49f49db1ab97eefb10d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:14:43 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] Creating volume d8bf71de-17dd-485c-a750-811adc054d8c {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:14:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:43 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:43 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:43 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:14:43 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:14:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:43 devstack sudo[97309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c 1073741824 Nov 03 13:14:43 devstack sudo[97309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:43 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-03b82d3a-b8af-4399-9075-68fd5cbc6286 tempest-GroupSnapshotsTest-1856318917 None] group_snapshot 45ccfe43-43f7-4abf-b7f7-1d69c7a3ccbb: created successfully Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] Flow 'volume_create_manager' (9eb9fa41-ec96-487d-9d92-7d6b81bdeb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b4e522e-d973-4e9b-83ef-bf013a282ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b4e522e-d973-4e9b-83ef-bf013a282ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1104334452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dcdfcef-8036-4941-875e-92dc5b45b12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d9f53903834773af191a671fc53375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:44Z,use_quota=True,user_id='7ead0b770b7a4a7ca46c3450f8aca4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58986573-98ab-4bc1-883c-8a9016521c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58986573-98ab-4bc1-883c-8a9016521c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a256d7-4954-4160-a165-ea41a7b29183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a256d7-4954-4160-a165-ea41a7b29183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dcdfcef-8036-4941-875e-92dc5b45b12b', 'volume_name': 'volume-3dcdfcef-8036-4941-875e-92dc5b45b12b', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df31e996-f8b2-4d9b-84c5-c3a9a803fca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df31e996-f8b2-4d9b-84c5-c3a9a803fca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed372ccf-0691-4801-806d-113b21170759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:44 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] Volume 3dcdfcef-8036-4941-875e-92dc5b45b12b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dcdfcef-8036-4941-875e-92dc5b45b12b', 'volume_size': 1} Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:44 devstack sudo[97309]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c 1073741824" returned: 0 in 0.552s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:44 devstack sudo[97371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c Nov 03 13:14:44 devstack sudo[97371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:44 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-09a5caa5-40ad-4a38-a657-d8fffd19cc6a tempest-GroupSnapshotsTest-1856318917 None] group_snapshot 45ccfe43-43f7-4abf-b7f7-1d69c7a3ccbb: deleting Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-09a5caa5-40ad-4a38-a657-d8fffd19cc6a tempest-GroupSnapshotsTest-1856318917 None] group_snapshot 45ccfe43-43f7-4abf-b7f7-1d69c7a3ccbb: deleting {{(pid=86725) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-09a5caa5-40ad-4a38-a657-d8fffd19cc6a tempest-GroupSnapshotsTest-1856318917 None] Acquiring lock "cinder-quobyte-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:44 devstack sudo[97371]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c" returned: 0 in 0.377s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-09a5caa5-40ad-4a38-a657-d8fffd19cc6a tempest-GroupSnapshotsTest-1856318917 None] Lock "cinder-quobyte-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-09a5caa5-40ad-4a38-a657-d8fffd19cc6a tempest-GroupSnapshotsTest-1856318917 None] Acquiring lock "cinder-quobyte-fd79ae64-f7f8-4ffd-905c-2bb9d5e90397" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.557s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1104334452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dcdfcef-8036-4941-875e-92dc5b45b12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d9f53903834773af191a671fc53375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:44Z,use_quota=True,user_id='7ead0b770b7a4a7ca46c3450f8aca4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] Creating volume 3dcdfcef-8036-4941-875e-92dc5b45b12b {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:14:44 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3dcdfcef-8036-4941-875e-92dc5b45b12b 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-09a5caa5-40ad-4a38-a657-d8fffd19cc6a tempest-GroupSnapshotsTest-1856318917 None] Lock "cinder-quobyte-fd79ae64-f7f8-4ffd-905c-2bb9d5e90397" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:44 devstack sudo[97376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3dcdfcef-8036-4941-875e-92dc5b45b12b 1073741824 Nov 03 13:14:44 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-09a5caa5-40ad-4a38-a657-d8fffd19cc6a tempest-GroupSnapshotsTest-1856318917 None] Deleting offline snapshot fd79ae64-f7f8-4ffd-905c-2bb9d5e90397 of volume 8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-09a5caa5-40ad-4a38-a657-d8fffd19cc6a tempest-GroupSnapshotsTest-1856318917 None] snapshot_file for this snap is: volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd.fd79ae64-f7f8-4ffd-905c-2bb9d5e90397 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ab7e279-9600-4b6a-ae12-7a3c2b397caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8bf71de-17dd-485c-a750-811adc054d8c', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a32cb5f-f960-436e-b2c1-1b65ceee1696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58c8764-8a5e-41b0-a6a5-25e72eed3b8d]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-09a5caa5-40ad-4a38-a657-d8fffd19cc6a tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd.fd79ae64-f7f8-4ffd-905c-2bb9d5e90397 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:44 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] Volume volume-d8bf71de-17dd-485c-a750-811adc054d8c (d8bf71de-17dd-485c-a750-811adc054d8c): created successfully Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a32cb5f-f960-436e-b2c1-1b65ceee1696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] Flow 'volume_create_manager' (db83ac51-d554-4fbb-8543-c8425540ffc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:44 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-e4a66885-a7af-44e4-96f9-f7329137e11e tempest-VolumesSnapshotTestJSON-776558485 None] Created volume successfully. Nov 03 13:14:44 devstack sudo[97378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd.fd79ae64-f7f8-4ffd-905c-2bb9d5e90397 Nov 03 13:14:44 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:45 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3dcdfcef-8036-4941-875e-92dc5b45b12b 1073741824" returned: 0 in 0.451s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3dcdfcef-8036-4941-875e-92dc5b45b12b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:45 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-09a5caa5-40ad-4a38-a657-d8fffd19cc6a tempest-GroupSnapshotsTest-1856318917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd.fd79ae64-f7f8-4ffd-905c-2bb9d5e90397" returned: 0 in 0.411s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:45 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-09a5caa5-40ad-4a38-a657-d8fffd19cc6a tempest-GroupSnapshotsTest-1856318917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:14:45 devstack sudo[97388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3dcdfcef-8036-4941-875e-92dc5b45b12b Nov 03 13:14:45 devstack sudo[97388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:45 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d400aea-7ac8-4bce-a4f9-39d01b3510d8]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-09a5caa5-40ad-4a38-a657-d8fffd19cc6a tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:45 devstack sudo[97390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd Nov 03 13:14:45 devstack sudo[97390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:45 devstack sudo[97388]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3dcdfcef-8036-4941-875e-92dc5b45b12b" returned: 0 in 0.244s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:45 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:14:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed372ccf-0691-4801-806d-113b21170759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dcdfcef-8036-4941-875e-92dc5b45b12b', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27358f0d-4c92-46d6-bf07-2852521a6c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:45 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] Volume volume-3dcdfcef-8036-4941-875e-92dc5b45b12b (3dcdfcef-8036-4941-875e-92dc5b45b12b): created successfully Nov 03 13:14:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27358f0d-4c92-46d6-bf07-2852521a6c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] Flow 'volume_create_manager' (9eb9fa41-ec96-487d-9d92-7d6b81bdeb44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:45 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-b8c7bba9-aa83-4d06-b21f-6eed38d1e1ce tempest-VolumesTransfersTest-732065756 None] Created volume successfully. Nov 03 13:14:45 devstack sudo[97390]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-09a5caa5-40ad-4a38-a657-d8fffd19cc6a tempest-GroupSnapshotsTest-1856318917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd" returned: 0 in 0.371s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-09a5caa5-40ad-4a38-a657-d8fffd19cc6a tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd.fd79ae64-f7f8-4ffd-905c-2bb9d5e90397 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:45 devstack sudo[97398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd.fd79ae64-f7f8-4ffd-905c-2bb9d5e90397 Nov 03 13:14:45 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-fb4ce84f-f7f2-4e24-8a34-d1d8277e25c0 tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-fb4ce84f-f7f2-4e24-8a34-d1d8277e25c0 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:46 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-fb4ce84f-f7f2-4e24-8a34-d1d8277e25c0 tempest-VolumesSnapshotTestJSON-776558485 None] Creating offline snapshot b2c6101c-f4f5-4f15-9d65-b264539376d5 of volume d8bf71de-17dd-485c-a750-811adc054d8c {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:14:46 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-09a5caa5-40ad-4a38-a657-d8fffd19cc6a tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd.fd79ae64-f7f8-4ffd-905c-2bb9d5e90397" returned: 0 in 0.385s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-09a5caa5-40ad-4a38-a657-d8fffd19cc6a tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd.fd79ae64-f7f8-4ffd-905c-2bb9d5e90397 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:46 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3ac0e8-604a-44a2-9ed2-26b1f8145b84]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-fb4ce84f-f7f2-4e24-8a34-d1d8277e25c0 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:46 devstack sudo[97404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd.fd79ae64-f7f8-4ffd-905c-2bb9d5e90397 Nov 03 13:14:46 devstack sudo[97404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:46 devstack sudo[97405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c Nov 03 13:14:46 devstack sudo[97405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:46 devstack sudo[97404]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-09a5caa5-40ad-4a38-a657-d8fffd19cc6a tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd.fd79ae64-f7f8-4ffd-905c-2bb9d5e90397" returned: 0 in 0.295s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-09a5caa5-40ad-4a38-a657-d8fffd19cc6a tempest-GroupSnapshotsTest-1856318917 None] Lock "cinder-quobyte-fd79ae64-f7f8-4ffd-905c-2bb9d5e90397" released by "_delete_snapshot" :: held 1.589s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-09a5caa5-40ad-4a38-a657-d8fffd19cc6a tempest-GroupSnapshotsTest-1856318917 None] Lock "cinder-quobyte-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd" released by "delete_snapshot" :: held 1.639s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:46 devstack cinder-volume[86725]: WARNING cinder.quota [None req-09a5caa5-40ad-4a38-a657-d8fffd19cc6a tempest-GroupSnapshotsTest-1856318917 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-928634738 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-928634738, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:14:46 devstack cinder-volume[86725]: WARNING cinder.quota [None req-09a5caa5-40ad-4a38-a657-d8fffd19cc6a tempest-GroupSnapshotsTest-1856318917 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-928634738 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-928634738, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:14:46 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-09a5caa5-40ad-4a38-a657-d8fffd19cc6a tempest-GroupSnapshotsTest-1856318917 None] Created reservations ['80e90d5e-24be-41ac-bc27-dbac02fb9b3a', 'e7e60b23-6e0d-4e9f-bb1b-e3bcedff29bc', '55ca6ebf-9952-429d-b0e1-760a8ca0e53d', '4e985e5e-4083-431c-a135-8b28d7a6ff09'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:46 devstack sudo[97405]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-fb4ce84f-f7f2-4e24-8a34-d1d8277e25c0 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c" returned: 0 in 0.421s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-fb4ce84f-f7f2-4e24-8a34-d1d8277e25c0 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c.b2c6101c-f4f5-4f15-9d65-b264539376d5 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4e0526cd-b1c6-45af-9e57-dc62edca2086 tempest-VolumesTransfersTest-1120855229 None] Acquiring lock "cinder-3dcdfcef-8036-4941-875e-92dc5b45b12b-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:46 devstack sudo[97412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c.b2c6101c-f4f5-4f15-9d65-b264539376d5 1G Nov 03 13:14:46 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4e0526cd-b1c6-45af-9e57-dc62edca2086 tempest-VolumesTransfersTest-1120855229 None] Lock "cinder-3dcdfcef-8036-4941-875e-92dc5b45b12b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4e0526cd-b1c6-45af-9e57-dc62edca2086 tempest-VolumesTransfersTest-1120855229 None] Acquiring lock "cinder-quobyte-3dcdfcef-8036-4941-875e-92dc5b45b12b" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:46 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-09a5caa5-40ad-4a38-a657-d8fffd19cc6a tempest-GroupSnapshotsTest-1856318917 None] group_snapshot 45ccfe43-43f7-4abf-b7f7-1d69c7a3ccbb: deleted successfully Nov 03 13:14:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4e0526cd-b1c6-45af-9e57-dc62edca2086 tempest-VolumesTransfersTest-1120855229 None] Lock "cinder-quobyte-3dcdfcef-8036-4941-875e-92dc5b45b12b" acquired by "delete_volume" :: waited 0.022s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:46 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f480748-2414-4795-baf0-a885eca8ba75]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4e0526cd-b1c6-45af-9e57-dc62edca2086 tempest-VolumesTransfersTest-1120855229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3dcdfcef-8036-4941-875e-92dc5b45b12b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:46 devstack sudo[97414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3dcdfcef-8036-4941-875e-92dc5b45b12b Nov 03 13:14:46 devstack sudo[97414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:46 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-fb4ce84f-f7f2-4e24-8a34-d1d8277e25c0 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c.b2c6101c-f4f5-4f15-9d65-b264539376d5 1G" returned: 0 in 0.467s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-fb4ce84f-f7f2-4e24-8a34-d1d8277e25c0 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8bf71de-17dd-485c-a750-811adc054d8c -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c.b2c6101c-f4f5-4f15-9d65-b264539376d5 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:46 devstack sudo[97420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8bf71de-17dd-485c-a750-811adc054d8c -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c.b2c6101c-f4f5-4f15-9d65-b264539376d5 Nov 03 13:14:46 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:47 devstack sudo[97414]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4e0526cd-b1c6-45af-9e57-dc62edca2086 tempest-VolumesTransfersTest-1120855229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3dcdfcef-8036-4941-875e-92dc5b45b12b" returned: 0 in 0.417s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4e0526cd-b1c6-45af-9e57-dc62edca2086 tempest-VolumesTransfersTest-1120855229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3dcdfcef-8036-4941-875e-92dc5b45b12b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:47 devstack sudo[97424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3dcdfcef-8036-4941-875e-92dc5b45b12b Nov 03 13:14:47 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:47 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-fb4ce84f-f7f2-4e24-8a34-d1d8277e25c0 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8bf71de-17dd-485c-a750-811adc054d8c -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c.b2c6101c-f4f5-4f15-9d65-b264539376d5" returned: 0 in 0.338s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:47 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-fb4ce84f-f7f2-4e24-8a34-d1d8277e25c0 tempest-VolumesSnapshotTestJSON-776558485 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c.b2c6101c-f4f5-4f15-9d65-b264539376d5 is being set with open permissions: ugo+rw Nov 03 13:14:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-fb4ce84f-f7f2-4e24-8a34-d1d8277e25c0 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c.b2c6101c-f4f5-4f15-9d65-b264539376d5 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:47 devstack sudo[97430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c.b2c6101c-f4f5-4f15-9d65-b264539376d5 Nov 03 13:14:47 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:47 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:47 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-984821c7-ce6f-4613-8f7f-ade629a83b19 tempest-GroupSnapshotsTest-1856318917 None] Acquiring lock "cinder-quobyte-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4e0526cd-b1c6-45af-9e57-dc62edca2086 tempest-VolumesTransfersTest-1120855229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3dcdfcef-8036-4941-875e-92dc5b45b12b" returned: 0 in 0.277s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:47 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4e0526cd-b1c6-45af-9e57-dc62edca2086 tempest-VolumesTransfersTest-1120855229 None] Lock "cinder-quobyte-3dcdfcef-8036-4941-875e-92dc5b45b12b" released by "delete_volume" :: held 0.750s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:47 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-984821c7-ce6f-4613-8f7f-ade629a83b19 tempest-GroupSnapshotsTest-1856318917 None] Lock "cinder-quobyte-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd" acquired by "delete_volume" :: waited 0.037s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:47 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[16dd197d-ff2d-442d-886e-9435136e172d]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-984821c7-ce6f-4613-8f7f-ade629a83b19 tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:47 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-4e0526cd-b1c6-45af-9e57-dc62edca2086 tempest-VolumesTransfersTest-1120855229 None] Created reservations ['def8d2b0-1d6f-457f-b760-0d3bcf7f00c2', 'd198fe75-e5cc-4fcd-9915-9e64cd17aef9', 'a834056d-1052-4eb0-b883-1b8b27af83c4', '08e5af7c-c006-4ef0-8412-236ef00a8665'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:47 devstack sudo[97432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd Nov 03 13:14:47 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4e0526cd-b1c6-45af-9e57-dc62edca2086 tempest-VolumesTransfersTest-1120855229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4e0526cd-b1c6-45af-9e57-dc62edca2086 tempest-VolumesTransfersTest-1120855229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:47 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4e0526cd-b1c6-45af-9e57-dc62edca2086 tempest-VolumesTransfersTest-1120855229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:47 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4e0526cd-b1c6-45af-9e57-dc62edca2086 tempest-VolumesTransfersTest-1120855229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4e0526cd-b1c6-45af-9e57-dc62edca2086 tempest-VolumesTransfersTest-1120855229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4e0526cd-b1c6-45af-9e57-dc62edca2086 tempest-VolumesTransfersTest-1120855229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:47 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-fb4ce84f-f7f2-4e24-8a34-d1d8277e25c0 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c.b2c6101c-f4f5-4f15-9d65-b264539376d5" returned: 0 in 0.286s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:47 devstack sudo[97435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:14:47 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-fb4ce84f-f7f2-4e24-8a34-d1d8277e25c0 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:47 devstack sudo[97437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c.info Nov 03 13:14:47 devstack sudo[97437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:47 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:47 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-984821c7-ce6f-4613-8f7f-ade629a83b19 tempest-GroupSnapshotsTest-1856318917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd" returned: 0 in 0.446s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-984821c7-ce6f-4613-8f7f-ade629a83b19 tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4e0526cd-b1c6-45af-9e57-dc62edca2086 tempest-VolumesTransfersTest-1120855229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.322s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:47 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-4e0526cd-b1c6-45af-9e57-dc62edca2086 tempest-VolumesTransfersTest-1120855229 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:14:47 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-4e0526cd-b1c6-45af-9e57-dc62edca2086 tempest-VolumesTransfersTest-1120855229 None] Deleted volume successfully. Nov 03 13:14:47 devstack sudo[97445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd Nov 03 13:14:47 devstack sudo[97445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:47 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4e0526cd-b1c6-45af-9e57-dc62edca2086 tempest-VolumesTransfersTest-1120855229 None] Lock "cinder-3dcdfcef-8036-4941-875e-92dc5b45b12b-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:47 devstack sudo[97437]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-fb4ce84f-f7f2-4e24-8a34-d1d8277e25c0 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c.info" returned: 0 in 0.315s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:47 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-fb4ce84f-f7f2-4e24-8a34-d1d8277e25c0 tempest-VolumesSnapshotTestJSON-776558485 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c.info is being set with open permissions: ugo+rw Nov 03 13:14:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-fb4ce84f-f7f2-4e24-8a34-d1d8277e25c0 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:47 devstack sudo[97447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c.info Nov 03 13:14:47 devstack sudo[97447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:48 devstack sudo[97445]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-984821c7-ce6f-4613-8f7f-ade629a83b19 tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd" returned: 0 in 0.286s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:48 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-984821c7-ce6f-4613-8f7f-ade629a83b19 tempest-GroupSnapshotsTest-1856318917 None] Lock "cinder-quobyte-8cbb73df-e262-41c0-a9f7-85d1bc3cfdbd" released by "delete_volume" :: held 0.812s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:48 devstack sudo[97447]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-fb4ce84f-f7f2-4e24-8a34-d1d8277e25c0 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c.info" returned: 0 in 0.256s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-fb4ce84f-f7f2-4e24-8a34-d1d8277e25c0 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.224s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:48 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-fb4ce84f-f7f2-4e24-8a34-d1d8277e25c0 tempest-VolumesSnapshotTestJSON-776558485 None] Create snapshot completed successfully Nov 03 13:14:48 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-984821c7-ce6f-4613-8f7f-ade629a83b19 tempest-GroupSnapshotsTest-1856318917 None] Created reservations ['ae8b75e2-e836-4643-9dd3-cef0c706b953'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:48 devstack cinder-volume[86725]: WARNING cinder.quota [None req-984821c7-ce6f-4613-8f7f-ade629a83b19 tempest-GroupSnapshotsTest-1856318917 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-928634738 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-928634738, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:14:48 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-984821c7-ce6f-4613-8f7f-ade629a83b19 tempest-GroupSnapshotsTest-1856318917 None] Created reservations ['e866c59a-c309-44b1-9c2e-c33d48a9012f', 'e747b02c-861b-44d6-9f08-9b0cb1b1c893', 'b3c30ec8-b0b6-428e-bb18-c7fd566c2d84', '7ab2ea6e-d462-4b40-b296-c42c91719489'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-984821c7-ce6f-4613-8f7f-ade629a83b19 tempest-GroupSnapshotsTest-1856318917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-984821c7-ce6f-4613-8f7f-ade629a83b19 tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:48 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-984821c7-ce6f-4613-8f7f-ade629a83b19 tempest-GroupSnapshotsTest-1856318917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:48 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-984821c7-ce6f-4613-8f7f-ade629a83b19 tempest-GroupSnapshotsTest-1856318917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-984821c7-ce6f-4613-8f7f-ade629a83b19 tempest-GroupSnapshotsTest-1856318917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-984821c7-ce6f-4613-8f7f-ade629a83b19 tempest-GroupSnapshotsTest-1856318917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:48 devstack sudo[97451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:14:48 devstack sudo[97451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:48 devstack sudo[97451]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-984821c7-ce6f-4613-8f7f-ade629a83b19 tempest-GroupSnapshotsTest-1856318917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.294s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:48 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-984821c7-ce6f-4613-8f7f-ade629a83b19 tempest-GroupSnapshotsTest-1856318917 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:14:48 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-984821c7-ce6f-4613-8f7f-ade629a83b19 tempest-GroupSnapshotsTest-1856318917 None] Delete group completed successfully. Nov 03 13:14:49 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:14:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Flow 'volume_create_manager' (d279ed67-246b-4247-9d85-1f2d2c8cbe95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37279952-2119-46f9-9231-3d44840cb6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37279952-2119-46f9-9231-3d44840cb6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1224605695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9237b2f7-e5f5-4c13-8c91-5acf7761adf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f7772490b614805b084fa70f6a02200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=b2c6101c-f4f5-4f15-9d65-b264539376d5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:50Z,use_quota=True,user_id='92a7e66c78fb49f49db1ab97eefb10d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be8df674-4f92-40e1-a5d4-229b9366e293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be8df674-4f92-40e1-a5d4-229b9366e293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d49f583-31fe-4e8d-942e-6e6f8ff4d256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d49f583-31fe-4e8d-942e-6e6f8ff4d256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9237b2f7-e5f5-4c13-8c91-5acf7761adf1', 'volume_name': 'volume-9237b2f7-e5f5-4c13-8c91-5acf7761adf1', 'volume_size': 2, 'snapshot_id': 'b2c6101c-f4f5-4f15-9d65-b264539376d5'}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e0fc48-f334-469b-8b13-98ac7a57035d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e0fc48-f334-469b-8b13-98ac7a57035d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915494fd-e3cd-42cf-81b8-ccdea5f9d1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:49 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Volume 9237b2f7-e5f5-4c13-8c91-5acf7761adf1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9237b2f7-e5f5-4c13-8c91-5acf7761adf1', 'volume_size': 2, 'snapshot_id': 'b2c6101c-f4f5-4f15-9d65-b264539376d5'} Nov 03 13:14:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:49 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "cinder-quobyte-b2c6101c-f4f5-4f15-9d65-b264539376d5-9237b2f7-e5f5-4c13-8c91-5acf7761adf1" by "_create_volume_from_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-quobyte-b2c6101c-f4f5-4f15-9d65-b264539376d5-9237b2f7-e5f5-4c13-8c91-5acf7761adf1" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Creating volume 9237b2f7-e5f5-4c13-8c91-5acf7761adf1 from snapshot b2c6101c-f4f5-4f15-9d65-b264539376d5 {{(pid=86725) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 13:14:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:14:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "cinder-quobyte-9237b2f7-e5f5-4c13-8c91-5acf7761adf1" by "_copy_volume_from_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-quobyte-9237b2f7-e5f5-4c13-8c91-5acf7761adf1" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] snapshot: b2c6101c-f4f5-4f15-9d65-b264539376d5, volume: 9237b2f7-e5f5-4c13-8c91-5acf7761adf1, {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 13:14:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:50 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[44664fba-79e0-41b4-bb4b-7349eed3afc1]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c.b2c6101c-f4f5-4f15-9d65-b264539376d5 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:50 devstack sudo[97455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c.b2c6101c-f4f5-4f15-9d65-b264539376d5 Nov 03 13:14:50 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:50 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c.b2c6101c-f4f5-4f15-9d65-b264539376d5" returned: 0 in 0.425s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8bf71de-17dd-485c-a750-811adc054d8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:14:50 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aacdeac-0355-4770-8006-daa2d61de2f8]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:50 devstack sudo[97461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c Nov 03 13:14:50 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:51 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c" returned: 0 in 0.487s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 13:14:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Creating direct copy from snapshot {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 13:14:51 devstack cinder-volume[86725]: DEBUG cinder.utils [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Path /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9237b2f7-e5f5-4c13-8c91-5acf7761adf1 not found in is_blk_device check {{(pid=86725) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 13:14:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9237b2f7-e5f5-4c13-8c91-5acf7761adf1 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:51 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9237b2f7-e5f5-4c13-8c91-5acf7761adf1 Nov 03 13:14:51 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:56 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:14:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] Flow 'volume_create_manager' (43a5299d-b8c9-4246-9fe1-a82cda70b2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (366437c1-f02b-40e1-99dd-f4c7203b3aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (366437c1-f02b-40e1-99dd-f4c7203b3aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1842880379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e67707-2c33-41b5-bc68-4cc41f92937c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81156ed5d46d4083bdd89f6c65503c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:56Z,use_quota=True,user_id='c039c0a68df447a48cf141a39830ea27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe85525a-ed9e-4499-8a64-bc5b6cc6e6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe85525a-ed9e-4499-8a64-bc5b6cc6e6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6be5f59-ceef-449b-82e7-4c84739a23b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6be5f59-ceef-449b-82e7-4c84739a23b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01e67707-2c33-41b5-bc68-4cc41f92937c', 'volume_name': 'volume-01e67707-2c33-41b5-bc68-4cc41f92937c', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b61436e2-1aa7-4404-8638-972ab2e51e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b61436e2-1aa7-4404-8638-972ab2e51e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (835c8e6f-d180-460c-a4b4-e84f2e35379b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:56 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] Volume 01e67707-2c33-41b5-bc68-4cc41f92937c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01e67707-2c33-41b5-bc68-4cc41f92937c', 'volume_size': 1} Nov 03 13:14:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:58 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:14:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:58 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:14:58 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:59 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.638s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:59 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:14:59 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager._thread_info {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:14:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread count: 28 {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:14:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread info: [<_MainThread(MainThread, started 133507074375808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:15:00 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-c3c515c0-72a7-48bb-a8c9-6ed0362fb724 tempest-GroupSnapshotsV319Test-1775264810 None] Group tempest-GroupSnapshotsV319Test-Group-1784840326: creating Nov 03 13:15:00 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-c3c515c0-72a7-48bb-a8c9-6ed0362fb724 tempest-GroupSnapshotsV319Test-1775264810 None] Group tempest-GroupSnapshotsV319Test-Group-1784840326: created successfully Nov 03 13:15:00 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-c3c515c0-72a7-48bb-a8c9-6ed0362fb724 tempest-GroupSnapshotsV319Test-1775264810 None] Create group completed successfully. Nov 03 13:15:00 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9237b2f7-e5f5-4c13-8c91-5acf7761adf1" returned: 0 in 9.174s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:00 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c, size 1024.00 MB, duration 9.17 sec, destination /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9237b2f7-e5f5-4c13-8c91-5acf7761adf1 {{(pid=86725) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:15:00 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Converted 1024.00 MB image at 111.61 MB/s Nov 03 13:15:00 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9237b2f7-e5f5-4c13-8c91-5acf7761adf1 is being set with open permissions: ugo+rw Nov 03 13:15:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9237b2f7-e5f5-4c13-8c91-5acf7761adf1 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:00 devstack sudo[97492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9237b2f7-e5f5-4c13-8c91-5acf7761adf1 Nov 03 13:15:00 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:00 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9237b2f7-e5f5-4c13-8c91-5acf7761adf1" returned: 0 in 0.244s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-quobyte-9237b2f7-e5f5-4c13-8c91-5acf7761adf1" released by "_copy_volume_from_snapshot" :: held 10.449s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-quobyte-b2c6101c-f4f5-4f15-9d65-b264539376d5-9237b2f7-e5f5-4c13-8c91-5acf7761adf1" released by "_create_volume_from_snapshot" :: held 10.517s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.548s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.914s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:00 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1842880379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e67707-2c33-41b5-bc68-4cc41f92937c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81156ed5d46d4083bdd89f6c65503c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:56Z,use_quota=True,user_id='c039c0a68df447a48cf141a39830ea27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:15:00 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] Creating volume 01e67707-2c33-41b5-bc68-4cc41f92937c {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:15:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:00 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:15:00 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:15:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:00 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:15:00 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:15:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-01e67707-2c33-41b5-bc68-4cc41f92937c 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:00 devstack sudo[97495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-01e67707-2c33-41b5-bc68-4cc41f92937c 1073741824 Nov 03 13:15:00 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915494fd-e3cd-42cf-81b8-ccdea5f9d1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9237b2f7-e5f5-4c13-8c91-5acf7761adf1', 'volume_size': 2, 'snapshot_id': 'b2c6101c-f4f5-4f15-9d65-b264539376d5'}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8cace0-00b8-462a-9861-d3a5d3cab437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:00 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Volume volume-9237b2f7-e5f5-4c13-8c91-5acf7761adf1 (9237b2f7-e5f5-4c13-8c91-5acf7761adf1): created successfully Nov 03 13:15:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8cace0-00b8-462a-9861-d3a5d3cab437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Flow 'volume_create_manager' (d279ed67-246b-4247-9d85-1f2d2c8cbe95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:15:00 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-b73fee58-9dd7-4e59-b443-e2db5906ffd9 tempest-VolumesSnapshotTestJSON-776558485 None] Created volume successfully. Nov 03 13:15:00 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:15:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] Flow 'volume_create_manager' (120ab8e3-9909-4146-af99-be96f7b5e794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:15:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18704366-6573-46b7-ae27-877d688e4591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18704366-6573-46b7-ae27-877d688e4591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-163715920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c791cd76-fe62-4862-84ea-3621f066c710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c4c88c43454100ba7f6b3234e3bf00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:15:01Z,use_quota=True,user_id='de52b164c9ce47bfbe4598010f599a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f05474b4-02fb-46d9-8810-ffaf02ee8da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f05474b4-02fb-46d9-8810-ffaf02ee8da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48f7e810-04e9-4713-bffc-5c22b14254a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48f7e810-04e9-4713-bffc-5c22b14254a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c791cd76-fe62-4862-84ea-3621f066c710', 'volume_name': 'volume-c791cd76-fe62-4862-84ea-3621f066c710', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ed775d2-bc33-4225-964e-bc3e1a29ca89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ed775d2-bc33-4225-964e-bc3e1a29ca89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ac453cc-ee18-4b02-b621-bc7819ea5817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:00 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] Volume c791cd76-fe62-4862-84ea-3621f066c710: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c791cd76-fe62-4862-84ea-3621f066c710', 'volume_size': 1} Nov 03 13:15:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:01 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-01e67707-2c33-41b5-bc68-4cc41f92937c 1073741824" returned: 0 in 0.484s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-01e67707-2c33-41b5-bc68-4cc41f92937c {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:01 devstack sudo[97501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-01e67707-2c33-41b5-bc68-4cc41f92937c Nov 03 13:15:01 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e2d9ba32-e006-4dbc-9ce6-0de4693593d2 tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "cinder-9237b2f7-e5f5-4c13-8c91-5acf7761adf1-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e2d9ba32-e006-4dbc-9ce6-0de4693593d2 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-9237b2f7-e5f5-4c13-8c91-5acf7761adf1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e2d9ba32-e006-4dbc-9ce6-0de4693593d2 tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "cinder-quobyte-9237b2f7-e5f5-4c13-8c91-5acf7761adf1" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:01 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e2d9ba32-e006-4dbc-9ce6-0de4693593d2 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-quobyte-9237b2f7-e5f5-4c13-8c91-5acf7761adf1" acquired by "delete_volume" :: waited 0.015s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-01e67707-2c33-41b5-bc68-4cc41f92937c" returned: 0 in 0.312s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.380s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-163715920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c791cd76-fe62-4862-84ea-3621f066c710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c4c88c43454100ba7f6b3234e3bf00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:15:01Z,use_quota=True,user_id='de52b164c9ce47bfbe4598010f599a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] Creating volume c791cd76-fe62-4862-84ea-3621f066c710 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:15:01 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c791cd76-fe62-4862-84ea-3621f066c710 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0307c4d-a461-4ec2-ac85-754843fb1c5b]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e2d9ba32-e006-4dbc-9ce6-0de4693593d2 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9237b2f7-e5f5-4c13-8c91-5acf7761adf1 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:01 devstack sudo[97507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c791cd76-fe62-4862-84ea-3621f066c710 1073741824 Nov 03 13:15:01 devstack sudo[97507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (835c8e6f-d180-460c-a4b4-e84f2e35379b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01e67707-2c33-41b5-bc68-4cc41f92937c', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8292231-52ca-4470-be4b-4ab745263beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:01 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] Volume volume-01e67707-2c33-41b5-bc68-4cc41f92937c (01e67707-2c33-41b5-bc68-4cc41f92937c): created successfully Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8292231-52ca-4470-be4b-4ab745263beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] Flow 'volume_create_manager' (43a5299d-b8c9-4246-9fe1-a82cda70b2bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:15:01 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-7bff8094-b373-4bdf-9ce2-7e08fd967d7d tempest-AttachVolumeShelveTestJSON-1114335243 None] Created volume successfully. Nov 03 13:15:01 devstack sudo[97508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9237b2f7-e5f5-4c13-8c91-5acf7761adf1 Nov 03 13:15:01 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] Flow 'volume_create_manager' (f2e36fc3-0036-4c2e-a7d2-32e59388af27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac4a581-27ac-4fc9-b92e-908144ca1bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac4a581-27ac-4fc9-b92e-908144ca1bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2086739404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1598f356-4858-491e-a238-3e753dab48c1,host='devstack@QuobyteHD#QuobyteHD',id=294c9926-e891-43a7-9cf7-246c1b9534c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ff9f1ef932d4306ab4736cf7a1217ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:15:02Z,use_quota=True,user_id='31a30bbc57fc4c0c9f2447be5a7b6c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(185e4dcb-9d15-427c-9c7d-f6af404136b9),volume_type_id=185e4dcb-9d15-427c-9c7d-f6af404136b9)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4db4196-48f8-4aa3-a446-ee5a5d832157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4db4196-48f8-4aa3-a446-ee5a5d832157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3558df9-2392-4780-a603-176df2920629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3558df9-2392-4780-a603-176df2920629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '294c9926-e891-43a7-9cf7-246c1b9534c2', 'volume_name': 'volume-294c9926-e891-43a7-9cf7-246c1b9534c2', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d5e1112-4166-4e18-8010-d523159ef1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d5e1112-4166-4e18-8010-d523159ef1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69d10ba5-515a-4977-a0a4-6bc340727b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:01 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] Volume 294c9926-e891-43a7-9cf7-246c1b9534c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-294c9926-e891-43a7-9cf7-246c1b9534c2', 'volume_size': 1} Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:01 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e2d9ba32-e006-4dbc-9ce6-0de4693593d2 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9237b2f7-e5f5-4c13-8c91-5acf7761adf1" returned: 0 in 0.509s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e2d9ba32-e006-4dbc-9ce6-0de4693593d2 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9237b2f7-e5f5-4c13-8c91-5acf7761adf1 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:01 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9237b2f7-e5f5-4c13-8c91-5acf7761adf1 Nov 03 13:15:01 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:02 devstack sudo[97507]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c791cd76-fe62-4862-84ea-3621f066c710 1073741824" returned: 0 in 0.626s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c791cd76-fe62-4862-84ea-3621f066c710 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:02 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c791cd76-fe62-4862-84ea-3621f066c710 Nov 03 13:15:02 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:02 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e2d9ba32-e006-4dbc-9ce6-0de4693593d2 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9237b2f7-e5f5-4c13-8c91-5acf7761adf1" returned: 0 in 0.270s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e2d9ba32-e006-4dbc-9ce6-0de4693593d2 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-quobyte-9237b2f7-e5f5-4c13-8c91-5acf7761adf1" released by "delete_volume" :: held 0.848s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-e2d9ba32-e006-4dbc-9ce6-0de4693593d2 tempest-VolumesSnapshotTestJSON-776558485 None] Created reservations ['b9cd8acf-4071-4ef1-9194-a5cf0b76ebac', 'cf057398-786b-43c9-b57a-9ab71da42f02', '338e631e-ec00-4840-ae5a-0b868c6e14ca', '714903ba-586f-497a-a17e-edea6b78dedf'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:15:02 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c791cd76-fe62-4862-84ea-3621f066c710" returned: 0 in 0.260s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.488s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1598f356-4858-491e-a238-3e753dab48c1,created_at=2026-11-03T12:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2086739404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1598f356-4858-491e-a238-3e753dab48c1,host='devstack@QuobyteHD#QuobyteHD',id=294c9926-e891-43a7-9cf7-246c1b9534c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ff9f1ef932d4306ab4736cf7a1217ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:15:02Z,use_quota=True,user_id='31a30bbc57fc4c0c9f2447be5a7b6c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(185e4dcb-9d15-427c-9c7d-f6af404136b9),volume_type_id=185e4dcb-9d15-427c-9c7d-f6af404136b9)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] Creating volume 294c9926-e891-43a7-9cf7-246c1b9534c2 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:15:02 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e2d9ba32-e006-4dbc-9ce6-0de4693593d2 tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e2d9ba32-e006-4dbc-9ce6-0de4693593d2 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-e2d9ba32-e006-4dbc-9ce6-0de4693593d2 tempest-VolumesSnapshotTestJSON-776558485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:15:02 devstack sudo[97528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2 1073741824 Nov 03 13:15:02 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-e2d9ba32-e006-4dbc-9ce6-0de4693593d2 tempest-VolumesSnapshotTestJSON-776558485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e2d9ba32-e006-4dbc-9ce6-0de4693593d2 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e2d9ba32-e006-4dbc-9ce6-0de4693593d2 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ac453cc-ee18-4b02-b621-bc7819ea5817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c791cd76-fe62-4862-84ea-3621f066c710', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8ad89ec-744d-4f45-a92b-38b99568497b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:02 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] Volume volume-c791cd76-fe62-4862-84ea-3621f066c710 (c791cd76-fe62-4862-84ea-3621f066c710): created successfully Nov 03 13:15:02 devstack sudo[97530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8ad89ec-744d-4f45-a92b-38b99568497b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:02 devstack sudo[97530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] Flow 'volume_create_manager' (120ab8e3-9909-4146-af99-be96f7b5e794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:15:02 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-a65a79aa-6865-48a1-9ff9-f8675d20bcda tempest-VolumesTransfersV357Test-205085808 None] Created volume successfully. Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-18ed0742-a235-4fd7-a455-938240a9d87a tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "cinder-b2c6101c-f4f5-4f15-9d65-b264539376d5-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-18ed0742-a235-4fd7-a455-938240a9d87a tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-b2c6101c-f4f5-4f15-9d65-b264539376d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-18ed0742-a235-4fd7-a455-938240a9d87a tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "cinder-quobyte-d8bf71de-17dd-485c-a750-811adc054d8c" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-18ed0742-a235-4fd7-a455-938240a9d87a tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-quobyte-d8bf71de-17dd-485c-a750-811adc054d8c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-18ed0742-a235-4fd7-a455-938240a9d87a tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "cinder-quobyte-b2c6101c-f4f5-4f15-9d65-b264539376d5" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-18ed0742-a235-4fd7-a455-938240a9d87a tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-quobyte-b2c6101c-f4f5-4f15-9d65-b264539376d5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-18ed0742-a235-4fd7-a455-938240a9d87a tempest-VolumesSnapshotTestJSON-776558485 None] Deleting offline snapshot b2c6101c-f4f5-4f15-9d65-b264539376d5 of volume d8bf71de-17dd-485c-a750-811adc054d8c {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-18ed0742-a235-4fd7-a455-938240a9d87a tempest-VolumesSnapshotTestJSON-776558485 None] snapshot_file for this snap is: volume-d8bf71de-17dd-485c-a750-811adc054d8c.b2c6101c-f4f5-4f15-9d65-b264539376d5 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb986e68-008c-4ed6-85fb-a02e69088a34]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-18ed0742-a235-4fd7-a455-938240a9d87a tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c.b2c6101c-f4f5-4f15-9d65-b264539376d5 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:02 devstack sudo[97530]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e2d9ba32-e006-4dbc-9ce6-0de4693593d2 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.361s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-e2d9ba32-e006-4dbc-9ce6-0de4693593d2 tempest-VolumesSnapshotTestJSON-776558485 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:15:02 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-e2d9ba32-e006-4dbc-9ce6-0de4693593d2 tempest-VolumesSnapshotTestJSON-776558485 None] Deleted volume successfully. Nov 03 13:15:02 devstack sudo[97535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c.b2c6101c-f4f5-4f15-9d65-b264539376d5 Nov 03 13:15:02 devstack sudo[97535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e2d9ba32-e006-4dbc-9ce6-0de4693593d2 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-9237b2f7-e5f5-4c13-8c91-5acf7761adf1-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:02 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2 1073741824" returned: 0 in 0.544s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:02 devstack sudo[97539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2 Nov 03 13:15:02 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:03 devstack sudo[97535]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-18ed0742-a235-4fd7-a455-938240a9d87a tempest-VolumesSnapshotTestJSON-776558485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c.b2c6101c-f4f5-4f15-9d65-b264539376d5" returned: 0 in 0.499s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:03 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-18ed0742-a235-4fd7-a455-938240a9d87a tempest-VolumesSnapshotTestJSON-776558485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8bf71de-17dd-485c-a750-811adc054d8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:15:03 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f972088-8b8f-4c2c-ac0a-c10935bea164]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-18ed0742-a235-4fd7-a455-938240a9d87a tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:03 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2" returned: 0 in 0.377s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:03 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:15:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:03 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69d10ba5-515a-4977-a0a4-6bc340727b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-294c9926-e891-43a7-9cf7-246c1b9534c2', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:03 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ea95302-d257-4d6a-9379-b24f0a43a777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:03 devstack sudo[97546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c Nov 03 13:15:03 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:03 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] Volume volume-294c9926-e891-43a7-9cf7-246c1b9534c2 (294c9926-e891-43a7-9cf7-246c1b9534c2): created successfully Nov 03 13:15:03 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ea95302-d257-4d6a-9379-b24f0a43a777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:03 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] Flow 'volume_create_manager' (f2e36fc3-0036-4c2e-a7d2-32e59388af27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:15:03 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-909e49f8-b44f-4b23-8576-4c3e115d00c1 tempest-GroupSnapshotsV319Test-1775264810 None] Created volume successfully. Nov 03 13:15:03 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-18ed0742-a235-4fd7-a455-938240a9d87a tempest-VolumesSnapshotTestJSON-776558485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c" returned: 0 in 0.668s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-18ed0742-a235-4fd7-a455-938240a9d87a tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c.b2c6101c-f4f5-4f15-9d65-b264539376d5 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:03 devstack sudo[97562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c.b2c6101c-f4f5-4f15-9d65-b264539376d5 Nov 03 13:15:03 devstack sudo[97562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:03 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-f780f5f5-21bb-47fa-b0ab-719b9e53882d tempest-VolumesTransfersV357Test-1540013734 None] Transfer volume completed successfully. Nov 03 13:15:04 devstack sudo[97562]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-18ed0742-a235-4fd7-a455-938240a9d87a tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c.b2c6101c-f4f5-4f15-9d65-b264539376d5" returned: 0 in 0.443s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-18ed0742-a235-4fd7-a455-938240a9d87a tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c.b2c6101c-f4f5-4f15-9d65-b264539376d5 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:04 devstack sudo[97570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c.b2c6101c-f4f5-4f15-9d65-b264539376d5 Nov 03 13:15:04 devstack sudo[97570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:04 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-d7aa919e-a6c6-4e3b-b80e-01e62a6380bf tempest-GroupSnapshotsV319Test-1775264810 None] GroupSnapshot 04e30826-3167-49b3-913b-80139ed182ad: creating. Nov 03 13:15:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d7aa919e-a6c6-4e3b-b80e-01e62a6380bf tempest-GroupSnapshotsV319Test-1775264810 None] Group snapshot 04e30826-3167-49b3-913b-80139ed182ad: creating. {{(pid=86725) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 13:15:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d7aa919e-a6c6-4e3b-b80e-01e62a6380bf tempest-GroupSnapshotsV319Test-1775264810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d7aa919e-a6c6-4e3b-b80e-01e62a6380bf tempest-GroupSnapshotsV319Test-1775264810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:04 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-d7aa919e-a6c6-4e3b-b80e-01e62a6380bf tempest-GroupSnapshotsV319Test-1775264810 None] Creating offline snapshot 7e095b03-d08f-43b0-966e-d69f5e66bd27 of volume 294c9926-e891-43a7-9cf7-246c1b9534c2 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:15:04 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef962f1f-2053-4c5d-90ec-7832c189d90b]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d7aa919e-a6c6-4e3b-b80e-01e62a6380bf tempest-GroupSnapshotsV319Test-1775264810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:04 devstack sudo[97570]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-18ed0742-a235-4fd7-a455-938240a9d87a tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c.b2c6101c-f4f5-4f15-9d65-b264539376d5" returned: 0 in 0.367s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:04 devstack sudo[97572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2 Nov 03 13:15:04 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:04 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-bafcec94-246e-4042-bb14-5c1f3b6d11ee tempest-VolumesTransfersV357Test-370378708 None] Acquiring lock "cinder-c791cd76-fe62-4862-84ea-3621f066c710-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:04 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-18ed0742-a235-4fd7-a455-938240a9d87a tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-quobyte-b2c6101c-f4f5-4f15-9d65-b264539376d5" released by "_delete_snapshot" :: held 2.150s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:04 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-18ed0742-a235-4fd7-a455-938240a9d87a tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-quobyte-d8bf71de-17dd-485c-a750-811adc054d8c" released by "delete_snapshot" :: held 2.192s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:04 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-bafcec94-246e-4042-bb14-5c1f3b6d11ee tempest-VolumesTransfersV357Test-370378708 None] Lock "cinder-c791cd76-fe62-4862-84ea-3621f066c710-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:04 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-bafcec94-246e-4042-bb14-5c1f3b6d11ee tempest-VolumesTransfersV357Test-370378708 None] Acquiring lock "cinder-quobyte-c791cd76-fe62-4862-84ea-3621f066c710" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:04 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-bafcec94-246e-4042-bb14-5c1f3b6d11ee tempest-VolumesTransfersV357Test-370378708 None] Lock "cinder-quobyte-c791cd76-fe62-4862-84ea-3621f066c710" acquired by "delete_volume" :: waited 0.021s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:04 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-18ed0742-a235-4fd7-a455-938240a9d87a tempest-VolumesSnapshotTestJSON-776558485 None] Created reservations ['eff1f35b-8618-4fad-bebb-1b0ffd2d36c2', '8ba99676-9fe0-491b-8a0b-fb364a58374a', 'f598dfa3-c48b-48f3-94e2-ddb5913cb755', '220194d1-1bd2-437e-9a5b-3c55b6f67e42'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:15:04 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[397b7ff3-db12-4607-87cb-7f7037b45dad]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-bafcec94-246e-4042-bb14-5c1f3b6d11ee tempest-VolumesTransfersV357Test-370378708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c791cd76-fe62-4862-84ea-3621f066c710 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:05 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-18ed0742-a235-4fd7-a455-938240a9d87a tempest-VolumesSnapshotTestJSON-776558485 None] Delete snapshot completed successfully. Nov 03 13:15:05 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-18ed0742-a235-4fd7-a455-938240a9d87a tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-b2c6101c-f4f5-4f15-9d65-b264539376d5-delete_snapshot" released by "delete_snapshot" :: held 2.500s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:05 devstack sudo[97575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c791cd76-fe62-4862-84ea-3621f066c710 Nov 03 13:15:05 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:05 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d7aa919e-a6c6-4e3b-b80e-01e62a6380bf tempest-GroupSnapshotsV319Test-1775264810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2" returned: 0 in 0.540s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d7aa919e-a6c6-4e3b-b80e-01e62a6380bf tempest-GroupSnapshotsV319Test-1775264810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2.7e095b03-d08f-43b0-966e-d69f5e66bd27 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:05 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2.7e095b03-d08f-43b0-966e-d69f5e66bd27 1G Nov 03 13:15:05 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:05 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-bafcec94-246e-4042-bb14-5c1f3b6d11ee tempest-VolumesTransfersV357Test-370378708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c791cd76-fe62-4862-84ea-3621f066c710" returned: 0 in 0.417s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-bafcec94-246e-4042-bb14-5c1f3b6d11ee tempest-VolumesTransfersV357Test-370378708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c791cd76-fe62-4862-84ea-3621f066c710 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:05 devstack sudo[97587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c791cd76-fe62-4862-84ea-3621f066c710 Nov 03 13:15:05 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:05 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d7aa919e-a6c6-4e3b-b80e-01e62a6380bf tempest-GroupSnapshotsV319Test-1775264810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2.7e095b03-d08f-43b0-966e-d69f5e66bd27 1G" returned: 0 in 0.469s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d7aa919e-a6c6-4e3b-b80e-01e62a6380bf tempest-GroupSnapshotsV319Test-1775264810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-294c9926-e891-43a7-9cf7-246c1b9534c2 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2.7e095b03-d08f-43b0-966e-d69f5e66bd27 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:05 devstack sudo[97592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-294c9926-e891-43a7-9cf7-246c1b9534c2 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2.7e095b03-d08f-43b0-966e-d69f5e66bd27 Nov 03 13:15:05 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:05 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-bafcec94-246e-4042-bb14-5c1f3b6d11ee tempest-VolumesTransfersV357Test-370378708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c791cd76-fe62-4862-84ea-3621f066c710" returned: 0 in 0.283s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:05 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-bafcec94-246e-4042-bb14-5c1f3b6d11ee tempest-VolumesTransfersV357Test-370378708 None] Lock "cinder-quobyte-c791cd76-fe62-4862-84ea-3621f066c710" released by "delete_volume" :: held 0.765s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:05 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-bafcec94-246e-4042-bb14-5c1f3b6d11ee tempest-VolumesTransfersV357Test-370378708 None] Created reservations ['0f8801ad-0a02-4059-b782-cac9da0dd106', '15b31ee1-9bc1-40d8-ae63-cfbf6ff3dd5e', 'efb84804-b7a1-4d94-9104-b6dd8b3187c1', '43627ab7-e02b-4528-b80b-3db70d83bd5c'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:15:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-bafcec94-246e-4042-bb14-5c1f3b6d11ee tempest-VolumesTransfersV357Test-370378708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-bafcec94-246e-4042-bb14-5c1f3b6d11ee tempest-VolumesTransfersV357Test-370378708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:05 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-bafcec94-246e-4042-bb14-5c1f3b6d11ee tempest-VolumesTransfersV357Test-370378708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:15:05 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-bafcec94-246e-4042-bb14-5c1f3b6d11ee tempest-VolumesTransfersV357Test-370378708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:15:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-bafcec94-246e-4042-bb14-5c1f3b6d11ee tempest-VolumesTransfersV357Test-370378708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-bafcec94-246e-4042-bb14-5c1f3b6d11ee tempest-VolumesTransfersV357Test-370378708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:05 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-62dde15d-0c31-4f18-b9c4-3167d27cbde5 tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "cinder-d8bf71de-17dd-485c-a750-811adc054d8c-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:05 devstack sudo[97597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:15:05 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:05 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-62dde15d-0c31-4f18-b9c4-3167d27cbde5 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-d8bf71de-17dd-485c-a750-811adc054d8c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:05 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-62dde15d-0c31-4f18-b9c4-3167d27cbde5 tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "cinder-quobyte-d8bf71de-17dd-485c-a750-811adc054d8c" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:06 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-62dde15d-0c31-4f18-b9c4-3167d27cbde5 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-quobyte-d8bf71de-17dd-485c-a750-811adc054d8c" acquired by "delete_volume" :: waited 0.029s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:06 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d7aa919e-a6c6-4e3b-b80e-01e62a6380bf tempest-GroupSnapshotsV319Test-1775264810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-294c9926-e891-43a7-9cf7-246c1b9534c2 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2.7e095b03-d08f-43b0-966e-d69f5e66bd27" returned: 0 in 0.488s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:06 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-d7aa919e-a6c6-4e3b-b80e-01e62a6380bf tempest-GroupSnapshotsV319Test-1775264810 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2.7e095b03-d08f-43b0-966e-d69f5e66bd27 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 13:15:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d7aa919e-a6c6-4e3b-b80e-01e62a6380bf tempest-GroupSnapshotsV319Test-1775264810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2.7e095b03-d08f-43b0-966e-d69f5e66bd27 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:06 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[76862277-3e25-43c6-8b60-95fc63345e16]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-62dde15d-0c31-4f18-b9c4-3167d27cbde5 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:06 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2.7e095b03-d08f-43b0-966e-d69f5e66bd27 Nov 03 13:15:06 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:06 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-bafcec94-246e-4042-bb14-5c1f3b6d11ee tempest-VolumesTransfersV357Test-370378708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.380s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:06 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-bafcec94-246e-4042-bb14-5c1f3b6d11ee tempest-VolumesTransfersV357Test-370378708 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:15:06 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-bafcec94-246e-4042-bb14-5c1f3b6d11ee tempest-VolumesTransfersV357Test-370378708 None] Deleted volume successfully. Nov 03 13:15:06 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c Nov 03 13:15:06 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:06 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-bafcec94-246e-4042-bb14-5c1f3b6d11ee tempest-VolumesTransfersV357Test-370378708 None] Lock "cinder-c791cd76-fe62-4862-84ea-3621f066c710-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:06 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d7aa919e-a6c6-4e3b-b80e-01e62a6380bf tempest-GroupSnapshotsV319Test-1775264810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2.7e095b03-d08f-43b0-966e-d69f5e66bd27" returned: 0 in 0.341s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d7aa919e-a6c6-4e3b-b80e-01e62a6380bf tempest-GroupSnapshotsV319Test-1775264810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:06 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2.info Nov 03 13:15:06 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:06 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-62dde15d-0c31-4f18-b9c4-3167d27cbde5 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c" returned: 0 in 0.573s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-62dde15d-0c31-4f18-b9c4-3167d27cbde5 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:06 devstack sudo[97612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c Nov 03 13:15:06 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:06 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:15:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] Flow 'volume_create_manager' (63161ce4-c5bc-4a59-b892-aa0160afa482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:15:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a635299-dddd-4e41-83c1-6c40c723835b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:06 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d7aa919e-a6c6-4e3b-b80e-01e62a6380bf tempest-GroupSnapshotsV319Test-1775264810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2.info" returned: 0 in 0.411s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:06 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-d7aa919e-a6c6-4e3b-b80e-01e62a6380bf tempest-GroupSnapshotsV319Test-1775264810 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 13:15:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d7aa919e-a6c6-4e3b-b80e-01e62a6380bf tempest-GroupSnapshotsV319Test-1775264810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a635299-dddd-4e41-83c1-6c40c723835b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1388210781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c55e1ac-6d57-4f0e-99c4-7fdb56712c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c4c88c43454100ba7f6b3234e3bf00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:15:07Z,use_quota=True,user_id='de52b164c9ce47bfbe4598010f599a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fdb3934-f083-4d7a-bd5a-75cd49a530d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:06 devstack sudo[97615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2.info Nov 03 13:15:06 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fdb3934-f083-4d7a-bd5a-75cd49a530d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b78b99-99d5-4537-92a3-e75f3ec3380f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b78b99-99d5-4537-92a3-e75f3ec3380f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c55e1ac-6d57-4f0e-99c4-7fdb56712c02', 'volume_name': 'volume-3c55e1ac-6d57-4f0e-99c4-7fdb56712c02', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8230582e-0dc8-44a9-8d5a-3660e02254a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8230582e-0dc8-44a9-8d5a-3660e02254a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (597b48f4-f520-4c61-ac03-5effcec61056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:06 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] Volume 3c55e1ac-6d57-4f0e-99c4-7fdb56712c02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c55e1ac-6d57-4f0e-99c4-7fdb56712c02', 'volume_size': 1} Nov 03 13:15:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:07 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-62dde15d-0c31-4f18-b9c4-3167d27cbde5 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d8bf71de-17dd-485c-a750-811adc054d8c" returned: 0 in 0.388s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:07 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-62dde15d-0c31-4f18-b9c4-3167d27cbde5 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-quobyte-d8bf71de-17dd-485c-a750-811adc054d8c" released by "delete_volume" :: held 1.062s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:07 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-62dde15d-0c31-4f18-b9c4-3167d27cbde5 tempest-VolumesSnapshotTestJSON-776558485 None] Created reservations ['8526cfe5-bfdb-4fef-a3c7-6b97edc16bc7', '910e117a-2671-4e75-bfd1-0e3ceb81c735', '9fca1678-075b-45ec-946f-4b953d4fc7a7', '5740df5d-4fc7-4447-97e0-ca113bfc1fb0'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:15:07 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d7aa919e-a6c6-4e3b-b80e-01e62a6380bf tempest-GroupSnapshotsV319Test-1775264810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2.info" returned: 0 in 0.307s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d7aa919e-a6c6-4e3b-b80e-01e62a6380bf tempest-GroupSnapshotsV319Test-1775264810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.682s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.241s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:07 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1388210781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c55e1ac-6d57-4f0e-99c4-7fdb56712c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c4c88c43454100ba7f6b3234e3bf00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:15:07Z,use_quota=True,user_id='de52b164c9ce47bfbe4598010f599a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:15:07 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] Creating volume 3c55e1ac-6d57-4f0e-99c4-7fdb56712c02 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:15:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:07 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:15:07 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:15:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:07 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:15:07 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:15:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3c55e1ac-6d57-4f0e-99c4-7fdb56712c02 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:07 devstack sudo[97619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3c55e1ac-6d57-4f0e-99c4-7fdb56712c02 1073741824 Nov 03 13:15:07 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-62dde15d-0c31-4f18-b9c4-3167d27cbde5 tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-62dde15d-0c31-4f18-b9c4-3167d27cbde5 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:07 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-62dde15d-0c31-4f18-b9c4-3167d27cbde5 tempest-VolumesSnapshotTestJSON-776558485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:15:07 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-62dde15d-0c31-4f18-b9c4-3167d27cbde5 tempest-VolumesSnapshotTestJSON-776558485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:15:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-62dde15d-0c31-4f18-b9c4-3167d27cbde5 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-62dde15d-0c31-4f18-b9c4-3167d27cbde5 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:07 devstack sudo[97621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:15:07 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-d7aa919e-a6c6-4e3b-b80e-01e62a6380bf tempest-GroupSnapshotsV319Test-1775264810 None] group_snapshot 04e30826-3167-49b3-913b-80139ed182ad: created successfully Nov 03 13:15:07 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:07 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-62dde15d-0c31-4f18-b9c4-3167d27cbde5 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.318s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:07 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-62dde15d-0c31-4f18-b9c4-3167d27cbde5 tempest-VolumesSnapshotTestJSON-776558485 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:15:07 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-62dde15d-0c31-4f18-b9c4-3167d27cbde5 tempest-VolumesSnapshotTestJSON-776558485 None] Deleted volume successfully. Nov 03 13:15:07 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-62dde15d-0c31-4f18-b9c4-3167d27cbde5 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-d8bf71de-17dd-485c-a750-811adc054d8c-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:07 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3c55e1ac-6d57-4f0e-99c4-7fdb56712c02 1073741824" returned: 0 in 0.574s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3c55e1ac-6d57-4f0e-99c4-7fdb56712c02 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:07 devstack sudo[97628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3c55e1ac-6d57-4f0e-99c4-7fdb56712c02 Nov 03 13:15:07 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:08 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3c55e1ac-6d57-4f0e-99c4-7fdb56712c02" returned: 0 in 0.273s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:08 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:15:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (597b48f4-f520-4c61-ac03-5effcec61056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c55e1ac-6d57-4f0e-99c4-7fdb56712c02', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c9e2d5-27f9-4f0a-89fa-6351c7840430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:08 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] Volume volume-3c55e1ac-6d57-4f0e-99c4-7fdb56712c02 (3c55e1ac-6d57-4f0e-99c4-7fdb56712c02): created successfully Nov 03 13:15:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c9e2d5-27f9-4f0a-89fa-6351c7840430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] Flow 'volume_create_manager' (63161ce4-c5bc-4a59-b892-aa0160afa482) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:15:08 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-2b9d040c-0523-4c70-a47b-21821ee27901 tempest-VolumesTransfersV357Test-205085808 None] Created volume successfully. Nov 03 13:15:08 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-14a6b183-bd7d-4988-afe9-27aae99dd593 tempest-GroupSnapshotsV319Test-1775264810 None] group_snapshot 04e30826-3167-49b3-913b-80139ed182ad: deleting Nov 03 13:15:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-14a6b183-bd7d-4988-afe9-27aae99dd593 tempest-GroupSnapshotsV319Test-1775264810 None] group_snapshot 04e30826-3167-49b3-913b-80139ed182ad: deleting {{(pid=86725) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 13:15:08 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-14a6b183-bd7d-4988-afe9-27aae99dd593 tempest-GroupSnapshotsV319Test-1775264810 None] Acquiring lock "cinder-quobyte-294c9926-e891-43a7-9cf7-246c1b9534c2" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:08 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-14a6b183-bd7d-4988-afe9-27aae99dd593 tempest-GroupSnapshotsV319Test-1775264810 None] Lock "cinder-quobyte-294c9926-e891-43a7-9cf7-246c1b9534c2" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:08 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-14a6b183-bd7d-4988-afe9-27aae99dd593 tempest-GroupSnapshotsV319Test-1775264810 None] Acquiring lock "cinder-quobyte-7e095b03-d08f-43b0-966e-d69f5e66bd27" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:08 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-14a6b183-bd7d-4988-afe9-27aae99dd593 tempest-GroupSnapshotsV319Test-1775264810 None] Lock "cinder-quobyte-7e095b03-d08f-43b0-966e-d69f5e66bd27" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:08 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-14a6b183-bd7d-4988-afe9-27aae99dd593 tempest-GroupSnapshotsV319Test-1775264810 None] Deleting offline snapshot 7e095b03-d08f-43b0-966e-d69f5e66bd27 of volume 294c9926-e891-43a7-9cf7-246c1b9534c2 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:15:08 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-14a6b183-bd7d-4988-afe9-27aae99dd593 tempest-GroupSnapshotsV319Test-1775264810 None] snapshot_file for this snap is: volume-294c9926-e891-43a7-9cf7-246c1b9534c2.7e095b03-d08f-43b0-966e-d69f5e66bd27 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:15:08 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[acce0389-12e6-4c8c-9188-43a6fd1392a3]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-14a6b183-bd7d-4988-afe9-27aae99dd593 tempest-GroupSnapshotsV319Test-1775264810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2.7e095b03-d08f-43b0-966e-d69f5e66bd27 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:08 devstack sudo[97632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2.7e095b03-d08f-43b0-966e-d69f5e66bd27 Nov 03 13:15:08 devstack sudo[97632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:08 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:15:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] Flow 'volume_create_manager' (43e10b70-0e2e-4b10-a232-2b3e9b831f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:15:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b4e1f99-b03f-453b-a613-e9f5cf2ae314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b4e1f99-b03f-453b-a613-e9f5cf2ae314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-559736607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c41a44e-9312-4d4b-9582-c0b1fdafe60c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f7772490b614805b084fa70f6a02200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:15:09Z,use_quota=True,user_id='92a7e66c78fb49f49db1ab97eefb10d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (634fa280-6dfd-4794-9055-8ef6aa956fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:08 devstack sudo[97632]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (634fa280-6dfd-4794-9055-8ef6aa956fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af7b61e-920a-4b61-aa9a-79bc1a682294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af7b61e-920a-4b61-aa9a-79bc1a682294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c41a44e-9312-4d4b-9582-c0b1fdafe60c', 'volume_name': 'volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fa06725-4b21-4d2a-bff4-8bb1a77016ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fa06725-4b21-4d2a-bff4-8bb1a77016ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f301a9c-7236-4b22-bd67-15b117bbfad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:09 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] Volume 6c41a44e-9312-4d4b-9582-c0b1fdafe60c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c', 'volume_size': 1} Nov 03 13:15:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:09 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-559736607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c41a44e-9312-4d4b-9582-c0b1fdafe60c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f7772490b614805b084fa70f6a02200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:15:09Z,use_quota=True,user_id='92a7e66c78fb49f49db1ab97eefb10d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:15:09 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] Creating volume 6c41a44e-9312-4d4b-9582-c0b1fdafe60c {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:15:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:09 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:15:09 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:15:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:09 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:15:09 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:15:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-14a6b183-bd7d-4988-afe9-27aae99dd593 tempest-GroupSnapshotsV319Test-1775264810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2.7e095b03-d08f-43b0-966e-d69f5e66bd27" returned: 0 in 0.593s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:09 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-14a6b183-bd7d-4988-afe9-27aae99dd593 tempest-GroupSnapshotsV319Test-1775264810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-294c9926-e891-43a7-9cf7-246c1b9534c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:15:09 devstack sudo[97638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c 1073741824 Nov 03 13:15:09 devstack sudo[97638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:09 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e00257-4bb5-485d-be8c-c94c52205698]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-14a6b183-bd7d-4988-afe9-27aae99dd593 tempest-GroupSnapshotsV319Test-1775264810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:09 devstack sudo[97640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2 Nov 03 13:15:09 devstack sudo[97640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:09 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d5de8acd-e1fc-4cfc-958c-3752cbb2d147 tempest-VolumesTransfersV357Test-370378708 None] Acquiring lock "cinder-3c55e1ac-6d57-4f0e-99c4-7fdb56712c02-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:09 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d5de8acd-e1fc-4cfc-958c-3752cbb2d147 tempest-VolumesTransfersV357Test-370378708 None] Lock "cinder-3c55e1ac-6d57-4f0e-99c4-7fdb56712c02-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:09 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d5de8acd-e1fc-4cfc-958c-3752cbb2d147 tempest-VolumesTransfersV357Test-370378708 None] Acquiring lock "cinder-quobyte-3c55e1ac-6d57-4f0e-99c4-7fdb56712c02" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:09 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d5de8acd-e1fc-4cfc-958c-3752cbb2d147 tempest-VolumesTransfersV357Test-370378708 None] Lock "cinder-quobyte-3c55e1ac-6d57-4f0e-99c4-7fdb56712c02" acquired by "delete_volume" :: waited 0.019s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:09 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff670d6-d1ef-4ce9-bff1-ef42f2606498]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d5de8acd-e1fc-4cfc-958c-3752cbb2d147 tempest-VolumesTransfersV357Test-370378708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3c55e1ac-6d57-4f0e-99c4-7fdb56712c02 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:09 devstack sudo[97640]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-14a6b183-bd7d-4988-afe9-27aae99dd593 tempest-GroupSnapshotsV319Test-1775264810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2" returned: 0 in 0.438s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-14a6b183-bd7d-4988-afe9-27aae99dd593 tempest-GroupSnapshotsV319Test-1775264810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2.7e095b03-d08f-43b0-966e-d69f5e66bd27 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:09 devstack sudo[97645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3c55e1ac-6d57-4f0e-99c4-7fdb56712c02 Nov 03 13:15:09 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:09 devstack sudo[97652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2.7e095b03-d08f-43b0-966e-d69f5e66bd27 Nov 03 13:15:09 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:09 devstack sudo[97638]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c 1073741824" returned: 0 in 0.596s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:09 devstack sudo[97655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c Nov 03 13:15:09 devstack sudo[97655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:09 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d5de8acd-e1fc-4cfc-958c-3752cbb2d147 tempest-VolumesTransfersV357Test-370378708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3c55e1ac-6d57-4f0e-99c4-7fdb56712c02" returned: 0 in 0.517s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d5de8acd-e1fc-4cfc-958c-3752cbb2d147 tempest-VolumesTransfersV357Test-370378708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3c55e1ac-6d57-4f0e-99c4-7fdb56712c02 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:10 devstack sudo[97671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3c55e1ac-6d57-4f0e-99c4-7fdb56712c02 Nov 03 13:15:10 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:10 devstack sudo[97655]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c" returned: 0 in 0.387s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:10 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:15:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:10 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f301a9c-7236-4b22-bd67-15b117bbfad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:10 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cc602af-1cef-4063-b893-995b42e48ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:10 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:10 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] Volume volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c (6c41a44e-9312-4d4b-9582-c0b1fdafe60c): created successfully Nov 03 13:15:10 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cc602af-1cef-4063-b893-995b42e48ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:10 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] Flow 'volume_create_manager' (43e10b70-0e2e-4b10-a232-2b3e9b831f16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:15:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-14a6b183-bd7d-4988-afe9-27aae99dd593 tempest-GroupSnapshotsV319Test-1775264810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2.7e095b03-d08f-43b0-966e-d69f5e66bd27" returned: 0 in 0.635s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-14a6b183-bd7d-4988-afe9-27aae99dd593 tempest-GroupSnapshotsV319Test-1775264810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2.7e095b03-d08f-43b0-966e-d69f5e66bd27 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:10 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-b3a7ed8c-14e0-4085-b93e-7af50d022e73 tempest-VolumesSnapshotTestJSON-776558485 None] Created volume successfully. Nov 03 13:15:10 devstack sudo[97684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2.7e095b03-d08f-43b0-966e-d69f5e66bd27 Nov 03 13:15:10 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:10 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d5de8acd-e1fc-4cfc-958c-3752cbb2d147 tempest-VolumesTransfersV357Test-370378708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3c55e1ac-6d57-4f0e-99c4-7fdb56712c02" returned: 0 in 0.601s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:10 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d5de8acd-e1fc-4cfc-958c-3752cbb2d147 tempest-VolumesTransfersV357Test-370378708 None] Lock "cinder-quobyte-3c55e1ac-6d57-4f0e-99c4-7fdb56712c02" released by "delete_volume" :: held 1.174s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:10 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-14a6b183-bd7d-4988-afe9-27aae99dd593 tempest-GroupSnapshotsV319Test-1775264810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2.7e095b03-d08f-43b0-966e-d69f5e66bd27" returned: 0 in 0.404s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:10 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-14a6b183-bd7d-4988-afe9-27aae99dd593 tempest-GroupSnapshotsV319Test-1775264810 None] Lock "cinder-quobyte-7e095b03-d08f-43b0-966e-d69f5e66bd27" released by "_delete_snapshot" :: held 2.210s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:10 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-d5de8acd-e1fc-4cfc-958c-3752cbb2d147 tempest-VolumesTransfersV357Test-370378708 None] Created reservations ['9fafaaad-d3c6-4e7b-8613-90c26730ae2f', 'a35460e1-aa87-4c86-a8d9-42c07463f24a', '8382012b-f4ce-41cd-8adf-6c06fa39d951', '16e3a59e-d6de-4af5-9a32-83f8a4c4dc24'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:15:10 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-14a6b183-bd7d-4988-afe9-27aae99dd593 tempest-GroupSnapshotsV319Test-1775264810 None] Lock "cinder-quobyte-294c9926-e891-43a7-9cf7-246c1b9534c2" released by "delete_snapshot" :: held 2.241s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d5de8acd-e1fc-4cfc-958c-3752cbb2d147 tempest-VolumesTransfersV357Test-370378708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d5de8acd-e1fc-4cfc-958c-3752cbb2d147 tempest-VolumesTransfersV357Test-370378708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:10 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d5de8acd-e1fc-4cfc-958c-3752cbb2d147 tempest-VolumesTransfersV357Test-370378708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:15:10 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d5de8acd-e1fc-4cfc-958c-3752cbb2d147 tempest-VolumesTransfersV357Test-370378708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:15:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d5de8acd-e1fc-4cfc-958c-3752cbb2d147 tempest-VolumesTransfersV357Test-370378708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d5de8acd-e1fc-4cfc-958c-3752cbb2d147 tempest-VolumesTransfersV357Test-370378708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:10 devstack cinder-volume[86725]: WARNING cinder.quota [None req-14a6b183-bd7d-4988-afe9-27aae99dd593 tempest-GroupSnapshotsV319Test-1775264810 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-223764075 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-223764075, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:15:10 devstack cinder-volume[86725]: WARNING cinder.quota [None req-14a6b183-bd7d-4988-afe9-27aae99dd593 tempest-GroupSnapshotsV319Test-1775264810 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-223764075 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-223764075, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:15:10 devstack sudo[97689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:15:10 devstack sudo[97689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:10 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-14a6b183-bd7d-4988-afe9-27aae99dd593 tempest-GroupSnapshotsV319Test-1775264810 None] Created reservations ['ea3308d8-a772-40ca-9477-e168c3db0e2c', 'f0a47000-b153-439c-b82c-3b3f8076873b', 'aba89a24-bc0f-4c58-afbd-6d74c74343c8', 'a3f68953-801d-4cce-84a3-16e0a61fc924'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:15:10 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-14a6b183-bd7d-4988-afe9-27aae99dd593 tempest-GroupSnapshotsV319Test-1775264810 None] group_snapshot 04e30826-3167-49b3-913b-80139ed182ad: deleted successfully Nov 03 13:15:11 devstack sudo[97689]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d5de8acd-e1fc-4cfc-958c-3752cbb2d147 tempest-VolumesTransfersV357Test-370378708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.269s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:11 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-d5de8acd-e1fc-4cfc-958c-3752cbb2d147 tempest-VolumesTransfersV357Test-370378708 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:15:11 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-d5de8acd-e1fc-4cfc-958c-3752cbb2d147 tempest-VolumesTransfersV357Test-370378708 None] Deleted volume successfully. Nov 03 13:15:11 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d5de8acd-e1fc-4cfc-958c-3752cbb2d147 tempest-VolumesTransfersV357Test-370378708 None] Lock "cinder-3c55e1ac-6d57-4f0e-99c4-7fdb56712c02-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-6fd5a201-01df-4d71-8d89-33cd8d48a4b9 tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-6fd5a201-01df-4d71-8d89-33cd8d48a4b9 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:11 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-6fd5a201-01df-4d71-8d89-33cd8d48a4b9 tempest-VolumesSnapshotTestJSON-776558485 None] Creating offline snapshot 8eb65a3c-3069-4ec6-a9ad-ac5138436039 of volume 6c41a44e-9312-4d4b-9582-c0b1fdafe60c {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:15:11 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[85dc19c1-5912-4499-a26f-8ac84cf09264]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-6fd5a201-01df-4d71-8d89-33cd8d48a4b9 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:11 devstack sudo[97692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c Nov 03 13:15:11 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:11 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-6fd5a201-01df-4d71-8d89-33cd8d48a4b9 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c" returned: 0 in 0.351s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-6fd5a201-01df-4d71-8d89-33cd8d48a4b9 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c.8eb65a3c-3069-4ec6-a9ad-ac5138436039 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:11 devstack sudo[97697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c.8eb65a3c-3069-4ec6-a9ad-ac5138436039 1G Nov 03 13:15:11 devstack sudo[97697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:12 devstack sudo[97697]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-6fd5a201-01df-4d71-8d89-33cd8d48a4b9 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c.8eb65a3c-3069-4ec6-a9ad-ac5138436039 1G" returned: 0 in 0.542s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-6fd5a201-01df-4d71-8d89-33cd8d48a4b9 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c.8eb65a3c-3069-4ec6-a9ad-ac5138436039 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:12 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c.8eb65a3c-3069-4ec6-a9ad-ac5138436039 Nov 03 13:15:12 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:12 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5e7af555-812f-42d3-a33f-ee76d2e7bf63 tempest-GroupSnapshotsV319Test-1775264810 None] Acquiring lock "cinder-quobyte-294c9926-e891-43a7-9cf7-246c1b9534c2" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:12 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5e7af555-812f-42d3-a33f-ee76d2e7bf63 tempest-GroupSnapshotsV319Test-1775264810 None] Lock "cinder-quobyte-294c9926-e891-43a7-9cf7-246c1b9534c2" acquired by "delete_volume" :: waited 0.021s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:12 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93f2f9a-00e8-4841-953c-531794914c69]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5e7af555-812f-42d3-a33f-ee76d2e7bf63 tempest-GroupSnapshotsV319Test-1775264810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:12 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2 Nov 03 13:15:12 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:12 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-6fd5a201-01df-4d71-8d89-33cd8d48a4b9 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c.8eb65a3c-3069-4ec6-a9ad-ac5138436039" returned: 0 in 0.440s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:12 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-6fd5a201-01df-4d71-8d89-33cd8d48a4b9 tempest-VolumesSnapshotTestJSON-776558485 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c.8eb65a3c-3069-4ec6-a9ad-ac5138436039 is being set with open permissions: ugo+rw Nov 03 13:15:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-6fd5a201-01df-4d71-8d89-33cd8d48a4b9 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c.8eb65a3c-3069-4ec6-a9ad-ac5138436039 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:12 devstack sudo[97711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c.8eb65a3c-3069-4ec6-a9ad-ac5138436039 Nov 03 13:15:12 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:12 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:12 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5e7af555-812f-42d3-a33f-ee76d2e7bf63 tempest-GroupSnapshotsV319Test-1775264810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2" returned: 0 in 0.509s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-6fd5a201-01df-4d71-8d89-33cd8d48a4b9 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c.8eb65a3c-3069-4ec6-a9ad-ac5138436039" returned: 0 in 0.303s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5e7af555-812f-42d3-a33f-ee76d2e7bf63 tempest-GroupSnapshotsV319Test-1775264810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:12 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2 Nov 03 13:15:12 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-6fd5a201-01df-4d71-8d89-33cd8d48a4b9 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:12 devstack sudo[97720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c.info Nov 03 13:15:12 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:13 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5e7af555-812f-42d3-a33f-ee76d2e7bf63 tempest-GroupSnapshotsV319Test-1775264810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-294c9926-e891-43a7-9cf7-246c1b9534c2" returned: 0 in 0.305s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:13 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-6fd5a201-01df-4d71-8d89-33cd8d48a4b9 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c.info" returned: 0 in 0.283s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:13 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-6fd5a201-01df-4d71-8d89-33cd8d48a4b9 tempest-VolumesSnapshotTestJSON-776558485 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c.info is being set with open permissions: ugo+rw Nov 03 13:15:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-6fd5a201-01df-4d71-8d89-33cd8d48a4b9 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:13 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5e7af555-812f-42d3-a33f-ee76d2e7bf63 tempest-GroupSnapshotsV319Test-1775264810 None] Lock "cinder-quobyte-294c9926-e891-43a7-9cf7-246c1b9534c2" released by "delete_volume" :: held 0.952s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:13 devstack sudo[97724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c.info Nov 03 13:15:13 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:13 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-5e7af555-812f-42d3-a33f-ee76d2e7bf63 tempest-GroupSnapshotsV319Test-1775264810 None] Created reservations ['f9d5c583-f2ca-4335-afe7-d77010a309b8'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:15:13 devstack cinder-volume[86725]: WARNING cinder.quota [None req-5e7af555-812f-42d3-a33f-ee76d2e7bf63 tempest-GroupSnapshotsV319Test-1775264810 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-223764075 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-223764075, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:15:13 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-5e7af555-812f-42d3-a33f-ee76d2e7bf63 tempest-GroupSnapshotsV319Test-1775264810 None] Created reservations ['fd3fe689-1fe0-440a-93ad-fa808d7e3bda', 'a48b719e-4b25-4fc7-be7e-9a3007dde2a1', 'f2d5bab7-0c29-4718-8f2c-8c98cfd8bce6', '6f2633d5-ebb4-405f-a735-8e132c4da0a5'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:15:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-209acbf6-d99a-4f53-8ce9-b7f23432628d req-024a6a7b-1a6f-4d27-be0a-ad0d4a3bc8ed tempest-AttachVolumeShelveTestJSON-1114335243 None] No connector for attachment 4ffadc35-ceb4-4740-ab22-af3e51b8ef1f; skipping storage backend terminate_connection call. {{(pid=86725) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 03 13:15:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-209acbf6-d99a-4f53-8ce9-b7f23432628d req-024a6a7b-1a6f-4d27-be0a-ad0d4a3bc8ed tempest-AttachVolumeShelveTestJSON-1114335243 None] Deleting attachment 4ffadc35-ceb4-4740-ab22-af3e51b8ef1f. {{(pid=86725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:15:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5e7af555-812f-42d3-a33f-ee76d2e7bf63 tempest-GroupSnapshotsV319Test-1775264810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5e7af555-812f-42d3-a33f-ee76d2e7bf63 tempest-GroupSnapshotsV319Test-1775264810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5e7af555-812f-42d3-a33f-ee76d2e7bf63 tempest-GroupSnapshotsV319Test-1775264810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:15:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5e7af555-812f-42d3-a33f-ee76d2e7bf63 tempest-GroupSnapshotsV319Test-1775264810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:15:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5e7af555-812f-42d3-a33f-ee76d2e7bf63 tempest-GroupSnapshotsV319Test-1775264810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5e7af555-812f-42d3-a33f-ee76d2e7bf63 tempest-GroupSnapshotsV319Test-1775264810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:13 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-6fd5a201-01df-4d71-8d89-33cd8d48a4b9 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c.info" returned: 0 in 0.357s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:13 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:15:13 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-6fd5a201-01df-4d71-8d89-33cd8d48a4b9 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.405s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:13 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-6fd5a201-01df-4d71-8d89-33cd8d48a4b9 tempest-VolumesSnapshotTestJSON-776558485 None] Create snapshot completed successfully Nov 03 13:15:13 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5e7af555-812f-42d3-a33f-ee76d2e7bf63 tempest-GroupSnapshotsV319Test-1775264810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.318s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:13 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-5e7af555-812f-42d3-a33f-ee76d2e7bf63 tempest-GroupSnapshotsV319Test-1775264810 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:15:13 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-5e7af555-812f-42d3-a33f-ee76d2e7bf63 tempest-GroupSnapshotsV319Test-1775264810 None] Delete group completed successfully. Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Flow 'volume_create_manager' (2c6ef1a7-5365-4e44-8e01-75a42e2c1124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aee4e4d-a6b5-4902-8b99-76c6fb4969c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aee4e4d-a6b5-4902-8b99-76c6fb4969c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2119916084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e51d5cd7-663e-4468-b33b-b30bb2022a25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f7772490b614805b084fa70f6a02200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8eb65a3c-3069-4ec6-a9ad-ac5138436039,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:15:15Z,use_quota=True,user_id='92a7e66c78fb49f49db1ab97eefb10d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45fc6f03-4dca-48ec-aa46-d9d6b1c3bcce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45fc6f03-4dca-48ec-aa46-d9d6b1c3bcce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e00e38e7-7620-46fd-9475-d9ef731ae5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e00e38e7-7620-46fd-9475-d9ef731ae5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e51d5cd7-663e-4468-b33b-b30bb2022a25', 'volume_name': 'volume-e51d5cd7-663e-4468-b33b-b30bb2022a25', 'volume_size': 1, 'snapshot_id': '8eb65a3c-3069-4ec6-a9ad-ac5138436039'}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded19409-eed4-4639-a9e5-861c6d53a8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded19409-eed4-4639-a9e5-861c6d53a8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b87dccd3-ffd6-4403-9984-10ea6e85d4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:15 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Volume e51d5cd7-663e-4468-b33b-b30bb2022a25: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e51d5cd7-663e-4468-b33b-b30bb2022a25', 'volume_size': 1, 'snapshot_id': '8eb65a3c-3069-4ec6-a9ad-ac5138436039'} Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "cinder-quobyte-8eb65a3c-3069-4ec6-a9ad-ac5138436039-e51d5cd7-663e-4468-b33b-b30bb2022a25" by "_create_volume_from_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-quobyte-8eb65a3c-3069-4ec6-a9ad-ac5138436039-e51d5cd7-663e-4468-b33b-b30bb2022a25" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Creating volume e51d5cd7-663e-4468-b33b-b30bb2022a25 from snapshot 8eb65a3c-3069-4ec6-a9ad-ac5138436039 {{(pid=86725) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "cinder-quobyte-e51d5cd7-663e-4468-b33b-b30bb2022a25" by "_copy_volume_from_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-quobyte-e51d5cd7-663e-4468-b33b-b30bb2022a25" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] snapshot: 8eb65a3c-3069-4ec6-a9ad-ac5138436039, volume: e51d5cd7-663e-4468-b33b-b30bb2022a25, {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[1942e235-faf6-4f4d-b3f9-dc3f354821d9]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c.8eb65a3c-3069-4ec6-a9ad-ac5138436039 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:15 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c.8eb65a3c-3069-4ec6-a9ad-ac5138436039 Nov 03 13:15:15 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:15 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c.8eb65a3c-3069-4ec6-a9ad-ac5138436039" returned: 0 in 0.492s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aec1e54-3c7f-4a80-9b10-4a618dd554e9]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:16 devstack sudo[97739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c Nov 03 13:15:16 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:16 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c" returned: 0 in 0.480s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:16 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 13:15:16 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Creating direct copy from snapshot {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 13:15:16 devstack cinder-volume[86725]: DEBUG cinder.utils [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Path /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e51d5cd7-663e-4468-b33b-b30bb2022a25 not found in is_blk_device check {{(pid=86725) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 13:15:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e51d5cd7-663e-4468-b33b-b30bb2022a25 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:16 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e51d5cd7-663e-4468-b33b-b30bb2022a25 Nov 03 13:15:16 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:25 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:UPDATE=169,cinder:SELECT=156,cinder:INSERT=49,cinder:DELETE=11 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:15:25 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=154,cinder:UPDATE=169,cinder:INSERT=34,cinder:DELETE=9 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:15:25 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:15:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] Flow 'volume_create_manager' (c25a7209-80e1-4304-993f-258e3c72c128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:15:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e421b867-0eac-419c-bf99-8530b452d817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e421b867-0eac-419c-bf99-8530b452d817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-931342323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6e9ce96-64a5-4541-a2f9-29f679506a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e7f5d3d34f4e06976a2b979570efbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:15:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:15:26Z,use_quota=True,user_id='5a4c8fbc6465488e8d63734d84c28e93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc637d33-b4d4-4edb-92e4-9b94f53ade26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc637d33-b4d4-4edb-92e4-9b94f53ade26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18bd9fa1-1143-4042-adbb-ca4e9298fd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18bd9fa1-1143-4042-adbb-ca4e9298fd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6e9ce96-64a5-4541-a2f9-29f679506a12', 'volume_name': 'volume-c6e9ce96-64a5-4541-a2f9-29f679506a12', 'volume_size': 2}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18523ccc-9f2d-40aa-9286-a9e4d3c5db48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18523ccc-9f2d-40aa-9286-a9e4d3c5db48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d09346-f357-45b5-9f4c-ffa2e291a5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:26 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] Volume c6e9ce96-64a5-4541-a2f9-29f679506a12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6e9ce96-64a5-4541-a2f9-29f679506a12', 'volume_size': 2} Nov 03 13:15:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:26 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e51d5cd7-663e-4468-b33b-b30bb2022a25" returned: 0 in 9.748s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:26 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c, size 1024.00 MB, duration 9.75 sec, destination /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e51d5cd7-663e-4468-b33b-b30bb2022a25 {{(pid=86725) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:15:26 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Converted 1024.00 MB image at 105.03 MB/s Nov 03 13:15:26 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e51d5cd7-663e-4468-b33b-b30bb2022a25 is being set with open permissions: ugo+rw Nov 03 13:15:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e51d5cd7-663e-4468-b33b-b30bb2022a25 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:26 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e51d5cd7-663e-4468-b33b-b30bb2022a25 Nov 03 13:15:26 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:26 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e51d5cd7-663e-4468-b33b-b30bb2022a25" returned: 0 in 0.286s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:26 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-quobyte-e51d5cd7-663e-4468-b33b-b30bb2022a25" released by "_copy_volume_from_snapshot" :: held 11.138s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:26 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-quobyte-8eb65a3c-3069-4ec6-a9ad-ac5138436039-e51d5cd7-663e-4468-b33b-b30bb2022a25" released by "_create_volume_from_snapshot" :: held 11.229s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.255s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.452s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-931342323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6e9ce96-64a5-4541-a2f9-29f679506a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e7f5d3d34f4e06976a2b979570efbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:15:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:15:26Z,use_quota=True,user_id='5a4c8fbc6465488e8d63734d84c28e93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:15:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] Creating volume c6e9ce96-64a5-4541-a2f9-29f679506a12 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:15:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:15:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:15:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:15:26 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:15:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c6e9ce96-64a5-4541-a2f9-29f679506a12 2147483648 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:26 devstack sudo[97799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c6e9ce96-64a5-4541-a2f9-29f679506a12 2147483648 Nov 03 13:15:26 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b87dccd3-ffd6-4403-9984-10ea6e85d4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e51d5cd7-663e-4468-b33b-b30bb2022a25', 'volume_size': 1, 'snapshot_id': '8eb65a3c-3069-4ec6-a9ad-ac5138436039'}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e182f26-0e1d-4c2f-a7fa-c82e27eec48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:26 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Volume volume-e51d5cd7-663e-4468-b33b-b30bb2022a25 (e51d5cd7-663e-4468-b33b-b30bb2022a25): created successfully Nov 03 13:15:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e182f26-0e1d-4c2f-a7fa-c82e27eec48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Flow 'volume_create_manager' (2c6ef1a7-5365-4e44-8e01-75a42e2c1124) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:15:26 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-5e1e119b-2d06-46e9-8436-8e9e81344c38 tempest-VolumesSnapshotTestJSON-776558485 None] Created volume successfully. Nov 03 13:15:26 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1e3fb4eb-c40b-4196-8a5c-e1fd697717c1 tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "cinder-e51d5cd7-663e-4468-b33b-b30bb2022a25-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:26 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1e3fb4eb-c40b-4196-8a5c-e1fd697717c1 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-e51d5cd7-663e-4468-b33b-b30bb2022a25-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:26 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1e3fb4eb-c40b-4196-8a5c-e1fd697717c1 tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "cinder-quobyte-e51d5cd7-663e-4468-b33b-b30bb2022a25" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:27 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1e3fb4eb-c40b-4196-8a5c-e1fd697717c1 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-quobyte-e51d5cd7-663e-4468-b33b-b30bb2022a25" acquired by "delete_volume" :: waited 0.034s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:27 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[80944bb7-8487-4df1-afaa-3c1a63ad313e]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1e3fb4eb-c40b-4196-8a5c-e1fd697717c1 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e51d5cd7-663e-4468-b33b-b30bb2022a25 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:27 devstack sudo[97804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e51d5cd7-663e-4468-b33b-b30bb2022a25 Nov 03 13:15:27 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:27 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c6e9ce96-64a5-4541-a2f9-29f679506a12 2147483648" returned: 0 in 0.748s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c6e9ce96-64a5-4541-a2f9-29f679506a12 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:27 devstack sudo[97807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c6e9ce96-64a5-4541-a2f9-29f679506a12 Nov 03 13:15:27 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:27 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1e3fb4eb-c40b-4196-8a5c-e1fd697717c1 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e51d5cd7-663e-4468-b33b-b30bb2022a25" returned: 0 in 0.484s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1e3fb4eb-c40b-4196-8a5c-e1fd697717c1 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e51d5cd7-663e-4468-b33b-b30bb2022a25 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:27 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e51d5cd7-663e-4468-b33b-b30bb2022a25 Nov 03 13:15:27 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:27 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c6e9ce96-64a5-4541-a2f9-29f679506a12" returned: 0 in 0.560s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:27 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] <== create_volume: return (1387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:15:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d09346-f357-45b5-9f4c-ffa2e291a5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6e9ce96-64a5-4541-a2f9-29f679506a12', 'volume_size': 2}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62417a63-ec93-4a90-9b6e-59a83e38c59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:27 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] Volume volume-c6e9ce96-64a5-4541-a2f9-29f679506a12 (c6e9ce96-64a5-4541-a2f9-29f679506a12): created successfully Nov 03 13:15:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62417a63-ec93-4a90-9b6e-59a83e38c59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] Flow 'volume_create_manager' (c25a7209-80e1-4304-993f-258e3c72c128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:15:28 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-067f6231-a739-4210-be0b-54ef3ae1a3a7 tempest-VolumesCloneNegativeTest-527669407 None] Created volume successfully. Nov 03 13:15:28 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1e3fb4eb-c40b-4196-8a5c-e1fd697717c1 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e51d5cd7-663e-4468-b33b-b30bb2022a25" returned: 0 in 0.599s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:28 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1e3fb4eb-c40b-4196-8a5c-e1fd697717c1 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-quobyte-e51d5cd7-663e-4468-b33b-b30bb2022a25" released by "delete_volume" :: held 1.167s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:28 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-1e3fb4eb-c40b-4196-8a5c-e1fd697717c1 tempest-VolumesSnapshotTestJSON-776558485 None] Created reservations ['90b8fcca-a08b-466e-aa33-35a59ec091c2', '38c41d05-4ec3-42e4-97e8-2f0d49a358bd', '60fb7274-ed7f-41ee-b485-b11d5760c675', '8e3cdf26-31cb-48c3-b451-3afa4e7ec493'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:15:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1e3fb4eb-c40b-4196-8a5c-e1fd697717c1 tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1e3fb4eb-c40b-4196-8a5c-e1fd697717c1 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:28 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1e3fb4eb-c40b-4196-8a5c-e1fd697717c1 tempest-VolumesSnapshotTestJSON-776558485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:15:28 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1e3fb4eb-c40b-4196-8a5c-e1fd697717c1 tempest-VolumesSnapshotTestJSON-776558485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:15:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1e3fb4eb-c40b-4196-8a5c-e1fd697717c1 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1e3fb4eb-c40b-4196-8a5c-e1fd697717c1 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:28 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:15:28 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:28 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1e3fb4eb-c40b-4196-8a5c-e1fd697717c1 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.394s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:28 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-1e3fb4eb-c40b-4196-8a5c-e1fd697717c1 tempest-VolumesSnapshotTestJSON-776558485 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:15:28 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-1e3fb4eb-c40b-4196-8a5c-e1fd697717c1 tempest-VolumesSnapshotTestJSON-776558485 None] Deleted volume successfully. Nov 03 13:15:28 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1e3fb4eb-c40b-4196-8a5c-e1fd697717c1 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-e51d5cd7-663e-4468-b33b-b30bb2022a25-delete_volume" released by "delete_volume" :: held 1.938s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:29 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8ca1cabf-2155-49fd-a4f8-3b29f126e2bd tempest-VolumesCloneNegativeTest-527669407 None] Acquiring lock "cinder-c6e9ce96-64a5-4541-a2f9-29f679506a12-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:29 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8ca1cabf-2155-49fd-a4f8-3b29f126e2bd tempest-VolumesCloneNegativeTest-527669407 None] Lock "cinder-c6e9ce96-64a5-4541-a2f9-29f679506a12-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:29 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8ca1cabf-2155-49fd-a4f8-3b29f126e2bd tempest-VolumesCloneNegativeTest-527669407 None] Acquiring lock "cinder-quobyte-c6e9ce96-64a5-4541-a2f9-29f679506a12" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:29 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8ca1cabf-2155-49fd-a4f8-3b29f126e2bd tempest-VolumesCloneNegativeTest-527669407 None] Lock "cinder-quobyte-c6e9ce96-64a5-4541-a2f9-29f679506a12" acquired by "delete_volume" :: waited 0.025s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:29 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b717dd-8a26-4a31-92d9-6b62bac855b2]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8ca1cabf-2155-49fd-a4f8-3b29f126e2bd tempest-VolumesCloneNegativeTest-527669407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c6e9ce96-64a5-4541-a2f9-29f679506a12 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:29 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e771fada-06b7-4bf1-b0f0-e779b797a3b1 tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "cinder-8eb65a3c-3069-4ec6-a9ad-ac5138436039-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:29 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e771fada-06b7-4bf1-b0f0-e779b797a3b1 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-8eb65a3c-3069-4ec6-a9ad-ac5138436039-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:29 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e771fada-06b7-4bf1-b0f0-e779b797a3b1 tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "cinder-quobyte-6c41a44e-9312-4d4b-9582-c0b1fdafe60c" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:29 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e771fada-06b7-4bf1-b0f0-e779b797a3b1 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-quobyte-6c41a44e-9312-4d4b-9582-c0b1fdafe60c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:29 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e771fada-06b7-4bf1-b0f0-e779b797a3b1 tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "cinder-quobyte-8eb65a3c-3069-4ec6-a9ad-ac5138436039" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:29 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e771fada-06b7-4bf1-b0f0-e779b797a3b1 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-quobyte-8eb65a3c-3069-4ec6-a9ad-ac5138436039" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:29 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-e771fada-06b7-4bf1-b0f0-e779b797a3b1 tempest-VolumesSnapshotTestJSON-776558485 None] Deleting offline snapshot 8eb65a3c-3069-4ec6-a9ad-ac5138436039 of volume 6c41a44e-9312-4d4b-9582-c0b1fdafe60c {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:15:29 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-e771fada-06b7-4bf1-b0f0-e779b797a3b1 tempest-VolumesSnapshotTestJSON-776558485 None] snapshot_file for this snap is: volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c.8eb65a3c-3069-4ec6-a9ad-ac5138436039 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:15:29 devstack sudo[97886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c6e9ce96-64a5-4541-a2f9-29f679506a12 Nov 03 13:15:29 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:29 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6c6af8-ebc7-488a-956d-c6b06c220025]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e771fada-06b7-4bf1-b0f0-e779b797a3b1 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c.8eb65a3c-3069-4ec6-a9ad-ac5138436039 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:29 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c.8eb65a3c-3069-4ec6-a9ad-ac5138436039 Nov 03 13:15:29 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:29 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8ca1cabf-2155-49fd-a4f8-3b29f126e2bd tempest-VolumesCloneNegativeTest-527669407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c6e9ce96-64a5-4541-a2f9-29f679506a12" returned: 0 in 0.632s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8ca1cabf-2155-49fd-a4f8-3b29f126e2bd tempest-VolumesCloneNegativeTest-527669407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c6e9ce96-64a5-4541-a2f9-29f679506a12 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:29 devstack sudo[97895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c6e9ce96-64a5-4541-a2f9-29f679506a12 Nov 03 13:15:29 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:30 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e771fada-06b7-4bf1-b0f0-e779b797a3b1 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c.8eb65a3c-3069-4ec6-a9ad-ac5138436039" returned: 0 in 0.664s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:30 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-e771fada-06b7-4bf1-b0f0-e779b797a3b1 tempest-VolumesSnapshotTestJSON-776558485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:15:30 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c59c394-e667-45eb-a1b8-8ec26520a6ff]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e771fada-06b7-4bf1-b0f0-e779b797a3b1 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:30 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8ca1cabf-2155-49fd-a4f8-3b29f126e2bd tempest-VolumesCloneNegativeTest-527669407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c6e9ce96-64a5-4541-a2f9-29f679506a12" returned: 0 in 0.601s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:30 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8ca1cabf-2155-49fd-a4f8-3b29f126e2bd tempest-VolumesCloneNegativeTest-527669407 None] Lock "cinder-quobyte-c6e9ce96-64a5-4541-a2f9-29f679506a12" released by "delete_volume" :: held 1.311s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:30 devstack sudo[97900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c Nov 03 13:15:30 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:30 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-8ca1cabf-2155-49fd-a4f8-3b29f126e2bd tempest-VolumesCloneNegativeTest-527669407 None] Created reservations ['70ff429e-da81-4314-89d9-7cb2d4ceded0', '3985191e-9373-4a63-ac90-599a11435a06', 'bfb61505-6e41-442d-bf9a-0eca7f7e4d64', 'c8216a99-fedf-4d73-b87d-6404db5b2ead'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:15:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8ca1cabf-2155-49fd-a4f8-3b29f126e2bd tempest-VolumesCloneNegativeTest-527669407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8ca1cabf-2155-49fd-a4f8-3b29f126e2bd tempest-VolumesCloneNegativeTest-527669407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:30 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-8ca1cabf-2155-49fd-a4f8-3b29f126e2bd tempest-VolumesCloneNegativeTest-527669407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:15:30 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-8ca1cabf-2155-49fd-a4f8-3b29f126e2bd tempest-VolumesCloneNegativeTest-527669407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:15:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8ca1cabf-2155-49fd-a4f8-3b29f126e2bd tempest-VolumesCloneNegativeTest-527669407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8ca1cabf-2155-49fd-a4f8-3b29f126e2bd tempest-VolumesCloneNegativeTest-527669407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:30 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:15:30 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:31 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8ca1cabf-2155-49fd-a4f8-3b29f126e2bd tempest-VolumesCloneNegativeTest-527669407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.359s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:31 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-8ca1cabf-2155-49fd-a4f8-3b29f126e2bd tempest-VolumesCloneNegativeTest-527669407 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:15:31 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-8ca1cabf-2155-49fd-a4f8-3b29f126e2bd tempest-VolumesCloneNegativeTest-527669407 None] Deleted volume successfully. Nov 03 13:15:31 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8ca1cabf-2155-49fd-a4f8-3b29f126e2bd tempest-VolumesCloneNegativeTest-527669407 None] Lock "cinder-c6e9ce96-64a5-4541-a2f9-29f679506a12-delete_volume" released by "delete_volume" :: held 2.050s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:31 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e771fada-06b7-4bf1-b0f0-e779b797a3b1 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c" returned: 0 in 0.920s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e771fada-06b7-4bf1-b0f0-e779b797a3b1 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c.8eb65a3c-3069-4ec6-a9ad-ac5138436039 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:31 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c.8eb65a3c-3069-4ec6-a9ad-ac5138436039 Nov 03 13:15:31 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:31 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e771fada-06b7-4bf1-b0f0-e779b797a3b1 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c.8eb65a3c-3069-4ec6-a9ad-ac5138436039" returned: 0 in 0.487s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e771fada-06b7-4bf1-b0f0-e779b797a3b1 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c.8eb65a3c-3069-4ec6-a9ad-ac5138436039 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:31 devstack sudo[97916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c.8eb65a3c-3069-4ec6-a9ad-ac5138436039 Nov 03 13:15:31 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:32 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e771fada-06b7-4bf1-b0f0-e779b797a3b1 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c.8eb65a3c-3069-4ec6-a9ad-ac5138436039" returned: 0 in 0.365s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:32 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e771fada-06b7-4bf1-b0f0-e779b797a3b1 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-quobyte-8eb65a3c-3069-4ec6-a9ad-ac5138436039" released by "_delete_snapshot" :: held 2.682s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:32 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e771fada-06b7-4bf1-b0f0-e779b797a3b1 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-quobyte-6c41a44e-9312-4d4b-9582-c0b1fdafe60c" released by "delete_snapshot" :: held 2.718s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:32 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-e771fada-06b7-4bf1-b0f0-e779b797a3b1 tempest-VolumesSnapshotTestJSON-776558485 None] Created reservations ['ed6e6a79-e897-4436-bfa5-7b050a023f84', 'f722b921-5f41-4760-bf66-758e2ce78f03', '685c5976-c984-491e-b719-c017aabb1cf2', '6bcbe8b0-166f-4368-b786-a0731b6ae47f'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:15:32 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-e771fada-06b7-4bf1-b0f0-e779b797a3b1 tempest-VolumesSnapshotTestJSON-776558485 None] Delete snapshot completed successfully. Nov 03 13:15:32 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e771fada-06b7-4bf1-b0f0-e779b797a3b1 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-8eb65a3c-3069-4ec6-a9ad-ac5138436039-delete_snapshot" released by "delete_snapshot" :: held 2.917s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:32 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3639b927-edbf-4751-ba69-4c2817bc5c64 tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "cinder-6c41a44e-9312-4d4b-9582-c0b1fdafe60c-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:32 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3639b927-edbf-4751-ba69-4c2817bc5c64 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-6c41a44e-9312-4d4b-9582-c0b1fdafe60c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:32 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3639b927-edbf-4751-ba69-4c2817bc5c64 tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "cinder-quobyte-6c41a44e-9312-4d4b-9582-c0b1fdafe60c" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:32 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3639b927-edbf-4751-ba69-4c2817bc5c64 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-quobyte-6c41a44e-9312-4d4b-9582-c0b1fdafe60c" acquired by "delete_volume" :: waited 0.031s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:33 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[40eaee75-091c-443a-a2b2-bcb6ef1c494b]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3639b927-edbf-4751-ba69-4c2817bc5c64 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:33 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c Nov 03 13:15:33 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:33 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3639b927-edbf-4751-ba69-4c2817bc5c64 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c" returned: 0 in 0.497s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3639b927-edbf-4751-ba69-4c2817bc5c64 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:33 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c Nov 03 13:15:33 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:33 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3639b927-edbf-4751-ba69-4c2817bc5c64 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6c41a44e-9312-4d4b-9582-c0b1fdafe60c" returned: 0 in 0.296s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:33 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3639b927-edbf-4751-ba69-4c2817bc5c64 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-quobyte-6c41a44e-9312-4d4b-9582-c0b1fdafe60c" released by "delete_volume" :: held 0.886s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:33 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-3639b927-edbf-4751-ba69-4c2817bc5c64 tempest-VolumesSnapshotTestJSON-776558485 None] Created reservations ['6803f5a5-a2b0-418a-8ac5-28ee32b1eabf', 'd6c29422-0d4c-48b1-b657-6973981ff897', '257fd849-f356-41d5-b413-8d57a5800dfa', '70546b82-5e0b-4258-91d0-d6e49537f5de'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:15:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3639b927-edbf-4751-ba69-4c2817bc5c64 tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3639b927-edbf-4751-ba69-4c2817bc5c64 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:33 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3639b927-edbf-4751-ba69-4c2817bc5c64 tempest-VolumesSnapshotTestJSON-776558485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:15:34 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3639b927-edbf-4751-ba69-4c2817bc5c64 tempest-VolumesSnapshotTestJSON-776558485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:15:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3639b927-edbf-4751-ba69-4c2817bc5c64 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3639b927-edbf-4751-ba69-4c2817bc5c64 tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:34 devstack sudo[97927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:15:34 devstack sudo[97927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:34 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-624ea804-8ceb-480b-9cdc-2afe27aafe0f tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "cinder-817caf8e-63de-40aa-bab6-3b5451ed0423-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:34 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-624ea804-8ceb-480b-9cdc-2afe27aafe0f tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-817caf8e-63de-40aa-bab6-3b5451ed0423-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:34 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-624ea804-8ceb-480b-9cdc-2afe27aafe0f tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "cinder-quobyte-817caf8e-63de-40aa-bab6-3b5451ed0423" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:34 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-624ea804-8ceb-480b-9cdc-2afe27aafe0f tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-quobyte-817caf8e-63de-40aa-bab6-3b5451ed0423" acquired by "delete_volume" :: waited 0.045s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:34 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[411e6042-8842-4d80-b5cc-14f936365ed1]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-624ea804-8ceb-480b-9cdc-2afe27aafe0f tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:34 devstack sudo[97927]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3639b927-edbf-4751-ba69-4c2817bc5c64 tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.477s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:34 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3639b927-edbf-4751-ba69-4c2817bc5c64 tempest-VolumesSnapshotTestJSON-776558485 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:15:34 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-3639b927-edbf-4751-ba69-4c2817bc5c64 tempest-VolumesSnapshotTestJSON-776558485 None] Deleted volume successfully. Nov 03 13:15:34 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3639b927-edbf-4751-ba69-4c2817bc5c64 tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-6c41a44e-9312-4d4b-9582-c0b1fdafe60c-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:34 devstack sudo[97930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423 Nov 03 13:15:34 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:34 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-624ea804-8ceb-480b-9cdc-2afe27aafe0f tempest-VolumesSnapshotTestJSON-776558485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423" returned: 0 in 0.507s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-624ea804-8ceb-480b-9cdc-2afe27aafe0f tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:35 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423 Nov 03 13:15:35 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:35 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-624ea804-8ceb-480b-9cdc-2afe27aafe0f tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-817caf8e-63de-40aa-bab6-3b5451ed0423" returned: 0 in 0.314s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-624ea804-8ceb-480b-9cdc-2afe27aafe0f tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-quobyte-817caf8e-63de-40aa-bab6-3b5451ed0423" released by "delete_volume" :: held 0.928s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:35 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-624ea804-8ceb-480b-9cdc-2afe27aafe0f tempest-VolumesSnapshotTestJSON-776558485 None] Created reservations ['4f7befb2-dc7e-471a-9bef-ad7887182664', 'e458cf19-ab5b-49c6-87d3-59f28ac047c6', '08a61488-0aa8-4c23-ad8d-50785de2d13f', '4a6991bc-d64f-4734-8aef-cf5280a48414'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:15:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-624ea804-8ceb-480b-9cdc-2afe27aafe0f tempest-VolumesSnapshotTestJSON-776558485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-624ea804-8ceb-480b-9cdc-2afe27aafe0f tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:35 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-624ea804-8ceb-480b-9cdc-2afe27aafe0f tempest-VolumesSnapshotTestJSON-776558485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:15:35 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-624ea804-8ceb-480b-9cdc-2afe27aafe0f tempest-VolumesSnapshotTestJSON-776558485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:15:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-624ea804-8ceb-480b-9cdc-2afe27aafe0f tempest-VolumesSnapshotTestJSON-776558485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-624ea804-8ceb-480b-9cdc-2afe27aafe0f tempest-VolumesSnapshotTestJSON-776558485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:35 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:15:35 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:35 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-624ea804-8ceb-480b-9cdc-2afe27aafe0f tempest-VolumesSnapshotTestJSON-776558485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.400s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:35 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-624ea804-8ceb-480b-9cdc-2afe27aafe0f tempest-VolumesSnapshotTestJSON-776558485 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:15:35 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-624ea804-8ceb-480b-9cdc-2afe27aafe0f tempest-VolumesSnapshotTestJSON-776558485 None] Deleted volume successfully. Nov 03 13:15:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-624ea804-8ceb-480b-9cdc-2afe27aafe0f tempest-VolumesSnapshotTestJSON-776558485 None] Lock "cinder-817caf8e-63de-40aa-bab6-3b5451ed0423-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:41 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:15:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] Flow 'volume_create_manager' (d42e841a-6fd5-4ddf-994d-ac360d02cbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:15:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26e8ee2c-7645-4039-a83e-d14c45705391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26e8ee2c-7645-4039-a83e-d14c45705391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1393459131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fdbd2cc-f1bd-416d-9d73-64dab1d38f65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be43aede17a443ea9cb39964e25b1e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:15:41Z,use_quota=True,user_id='b3877c34b8804ef584be31dbf0f3f810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54a5f4b-6b67-40be-be2a-901d7381f8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54a5f4b-6b67-40be-be2a-901d7381f8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3756f51-5a1f-458d-9dda-523d3c1f5a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3756f51-5a1f-458d-9dda-523d3c1f5a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fdbd2cc-f1bd-416d-9d73-64dab1d38f65', 'volume_name': 'volume-3fdbd2cc-f1bd-416d-9d73-64dab1d38f65', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d0ea7b-07ce-4dc8-b515-80e45dee67b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d0ea7b-07ce-4dc8-b515-80e45dee67b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b30ab3f-8dd3-42c6-9f19-566dff123940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:41 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] Volume 3fdbd2cc-f1bd-416d-9d73-64dab1d38f65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fdbd2cc-f1bd-416d-9d73-64dab1d38f65', 'volume_size': 1} Nov 03 13:15:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:41 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1393459131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fdbd2cc-f1bd-416d-9d73-64dab1d38f65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be43aede17a443ea9cb39964e25b1e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:15:41Z,use_quota=True,user_id='b3877c34b8804ef584be31dbf0f3f810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:15:41 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] Creating volume 3fdbd2cc-f1bd-416d-9d73-64dab1d38f65 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:15:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:41 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:15:41 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:15:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:41 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:15:41 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:15:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3fdbd2cc-f1bd-416d-9d73-64dab1d38f65 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:41 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3fdbd2cc-f1bd-416d-9d73-64dab1d38f65 1073741824 Nov 03 13:15:41 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:42 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3fdbd2cc-f1bd-416d-9d73-64dab1d38f65 1073741824" returned: 0 in 0.736s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3fdbd2cc-f1bd-416d-9d73-64dab1d38f65 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:42 devstack sudo[97953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3fdbd2cc-f1bd-416d-9d73-64dab1d38f65 Nov 03 13:15:42 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:42 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3fdbd2cc-f1bd-416d-9d73-64dab1d38f65" returned: 0 in 0.289s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:42 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:15:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b30ab3f-8dd3-42c6-9f19-566dff123940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fdbd2cc-f1bd-416d-9d73-64dab1d38f65', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ff1ff1-9655-4263-92be-38958396e7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:42 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] Volume volume-3fdbd2cc-f1bd-416d-9d73-64dab1d38f65 (3fdbd2cc-f1bd-416d-9d73-64dab1d38f65): created successfully Nov 03 13:15:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ff1ff1-9655-4263-92be-38958396e7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] Flow 'volume_create_manager' (d42e841a-6fd5-4ddf-994d-ac360d02cbd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:15:42 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-26765083-a3a3-4d31-b06e-0221be21deb7 tempest-VolumesNegativeTest-2038583748 None] Created volume successfully. Nov 03 13:15:52 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:UPDATE=48,cinder:SELECT=32,cinder:INSERT=12,cinder:DELETE=2 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:15:52 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:UPDATE=44,cinder:SELECT=29,cinder:INSERT=11,cinder:DELETE=5 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:15:58 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:15:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:15:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:15:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:58 devstack sudo[98144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:15:58 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:59 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.382s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:59 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:15:59 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager._thread_info {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:15:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread count: 28 {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:15:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread info: [<_MainThread(MainThread, started 133507074375808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:16:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3001d96a-9956-4939-9699-53b8fc7fbfb9 tempest-AttachVolumeShelveTestJSON-1114335243 None] Acquiring lock "cinder-01e67707-2c33-41b5-bc68-4cc41f92937c-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:16:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3001d96a-9956-4939-9699-53b8fc7fbfb9 tempest-AttachVolumeShelveTestJSON-1114335243 None] Lock "cinder-01e67707-2c33-41b5-bc68-4cc41f92937c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:16:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3001d96a-9956-4939-9699-53b8fc7fbfb9 tempest-AttachVolumeShelveTestJSON-1114335243 None] Acquiring lock "cinder-quobyte-01e67707-2c33-41b5-bc68-4cc41f92937c" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:16:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3001d96a-9956-4939-9699-53b8fc7fbfb9 tempest-AttachVolumeShelveTestJSON-1114335243 None] Lock "cinder-quobyte-01e67707-2c33-41b5-bc68-4cc41f92937c" acquired by "delete_volume" :: waited 0.019s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:16:00 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4583402-4991-47ba-8da1-16324e3d76c6]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:16:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3001d96a-9956-4939-9699-53b8fc7fbfb9 tempest-AttachVolumeShelveTestJSON-1114335243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-01e67707-2c33-41b5-bc68-4cc41f92937c {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:00 devstack sudo[98148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-01e67707-2c33-41b5-bc68-4cc41f92937c Nov 03 13:16:00 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:00 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3001d96a-9956-4939-9699-53b8fc7fbfb9 tempest-AttachVolumeShelveTestJSON-1114335243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-01e67707-2c33-41b5-bc68-4cc41f92937c" returned: 0 in 0.449s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3001d96a-9956-4939-9699-53b8fc7fbfb9 tempest-AttachVolumeShelveTestJSON-1114335243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-01e67707-2c33-41b5-bc68-4cc41f92937c {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:00 devstack sudo[98153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-01e67707-2c33-41b5-bc68-4cc41f92937c Nov 03 13:16:00 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:01 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3001d96a-9956-4939-9699-53b8fc7fbfb9 tempest-AttachVolumeShelveTestJSON-1114335243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-01e67707-2c33-41b5-bc68-4cc41f92937c" returned: 0 in 0.315s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3001d96a-9956-4939-9699-53b8fc7fbfb9 tempest-AttachVolumeShelveTestJSON-1114335243 None] Lock "cinder-quobyte-01e67707-2c33-41b5-bc68-4cc41f92937c" released by "delete_volume" :: held 0.829s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:16:01 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-3001d96a-9956-4939-9699-53b8fc7fbfb9 tempest-AttachVolumeShelveTestJSON-1114335243 None] Created reservations ['3a553edd-2a8e-4d65-a147-b2f28b3f07c0', '5d6c7b01-8aae-4fc5-a8f6-480a1f814cf5', '7485f39f-9f24-4878-8bd9-2901b65ff68d', '00573eb3-f49d-4147-8ab1-b95b3f69f8c1'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:16:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3001d96a-9956-4939-9699-53b8fc7fbfb9 tempest-AttachVolumeShelveTestJSON-1114335243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:16:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3001d96a-9956-4939-9699-53b8fc7fbfb9 tempest-AttachVolumeShelveTestJSON-1114335243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:16:01 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3001d96a-9956-4939-9699-53b8fc7fbfb9 tempest-AttachVolumeShelveTestJSON-1114335243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:16:01 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3001d96a-9956-4939-9699-53b8fc7fbfb9 tempest-AttachVolumeShelveTestJSON-1114335243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:16:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3001d96a-9956-4939-9699-53b8fc7fbfb9 tempest-AttachVolumeShelveTestJSON-1114335243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:16:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3001d96a-9956-4939-9699-53b8fc7fbfb9 tempest-AttachVolumeShelveTestJSON-1114335243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:01 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:16:01 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:01 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3001d96a-9956-4939-9699-53b8fc7fbfb9 tempest-AttachVolumeShelveTestJSON-1114335243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.406s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:01 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3001d96a-9956-4939-9699-53b8fc7fbfb9 tempest-AttachVolumeShelveTestJSON-1114335243 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:16:01 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-3001d96a-9956-4939-9699-53b8fc7fbfb9 tempest-AttachVolumeShelveTestJSON-1114335243 None] Deleted volume successfully. Nov 03 13:16:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3001d96a-9956-4939-9699-53b8fc7fbfb9 tempest-AttachVolumeShelveTestJSON-1114335243 None] Lock "cinder-01e67707-2c33-41b5-bc68-4cc41f92937c-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:16:05 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:16:05 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] Flow 'volume_create_manager' (a811a546-d7c1-4041-a439-70bd35ecb624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:16:05 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2d0e2cf-f198-424b-bee2-3b805bb668b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:05 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2d0e2cf-f198-424b-bee2-3b805bb668b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1483462828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1afa2af3-ed6f-4da7-a848-67a583abfe31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5a9a86bfa8343e5bae936992dcce1c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:16:06Z,use_quota=True,user_id='a2fa3d5f5e114f6e8a6777b1c1e9824b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd2b593b-599f-489f-bc5e-8e6cd74b572b),volume_type_id=cd2b593b-599f-489f-bc5e-8e6cd74b572b)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:05 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a127d3a-ed12-45eb-aa0b-5a2cdc5ec72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:05 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a127d3a-ed12-45eb-aa0b-5a2cdc5ec72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:05 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e31613cb-588c-44c8-aee8-804d2abf3c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:05 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e31613cb-588c-44c8-aee8-804d2abf3c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1afa2af3-ed6f-4da7-a848-67a583abfe31', 'volume_name': 'volume-1afa2af3-ed6f-4da7-a848-67a583abfe31', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:05 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0feb09e1-4c6c-4968-af83-7b789bbaca72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:05 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0feb09e1-4c6c-4968-af83-7b789bbaca72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:05 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b20a9d80-56fa-4ad3-9502-70186199af4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:05 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] Volume 1afa2af3-ed6f-4da7-a848-67a583abfe31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1afa2af3-ed6f-4da7-a848-67a583abfe31', 'volume_size': 1} Nov 03 13:16:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:16:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:16:05 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1483462828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1afa2af3-ed6f-4da7-a848-67a583abfe31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5a9a86bfa8343e5bae936992dcce1c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:16:06Z,use_quota=True,user_id='a2fa3d5f5e114f6e8a6777b1c1e9824b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd2b593b-599f-489f-bc5e-8e6cd74b572b),volume_type_id=cd2b593b-599f-489f-bc5e-8e6cd74b572b)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:16:05 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] Creating volume 1afa2af3-ed6f-4da7-a848-67a583abfe31 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:16:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:16:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:16:05 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:16:05 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:16:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:16:05 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:16:05 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:16:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1afa2af3-ed6f-4da7-a848-67a583abfe31 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:05 devstack sudo[98163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1afa2af3-ed6f-4da7-a848-67a583abfe31 1073741824 Nov 03 13:16:05 devstack sudo[98163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:06 devstack sudo[98163]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1afa2af3-ed6f-4da7-a848-67a583abfe31 1073741824" returned: 0 in 0.757s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1afa2af3-ed6f-4da7-a848-67a583abfe31 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:06 devstack sudo[98171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1afa2af3-ed6f-4da7-a848-67a583abfe31 Nov 03 13:16:06 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:07 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1afa2af3-ed6f-4da7-a848-67a583abfe31" returned: 0 in 0.454s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:07 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:16:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:16:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b20a9d80-56fa-4ad3-9502-70186199af4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1afa2af3-ed6f-4da7-a848-67a583abfe31', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (783f2d76-d03f-44fa-aa73-0683143bc394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:07 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] Volume volume-1afa2af3-ed6f-4da7-a848-67a583abfe31 (1afa2af3-ed6f-4da7-a848-67a583abfe31): created successfully Nov 03 13:16:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (783f2d76-d03f-44fa-aa73-0683143bc394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] Flow 'volume_create_manager' (a811a546-d7c1-4041-a439-70bd35ecb624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:16:07 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-0e243aac-19cb-4db7-ac8b-b5ccff049643 tempest-VolumeTypesAccessTest-1968370931 None] Created volume successfully. Nov 03 13:16:07 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b6cc392a-cae6-4236-9af9-429eb4657b91 tempest-VolumeTypesAccessTest-1968370931 None] Acquiring lock "cinder-1afa2af3-ed6f-4da7-a848-67a583abfe31-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:16:07 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b6cc392a-cae6-4236-9af9-429eb4657b91 tempest-VolumeTypesAccessTest-1968370931 None] Lock "cinder-1afa2af3-ed6f-4da7-a848-67a583abfe31-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:16:07 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b6cc392a-cae6-4236-9af9-429eb4657b91 tempest-VolumeTypesAccessTest-1968370931 None] Acquiring lock "cinder-quobyte-1afa2af3-ed6f-4da7-a848-67a583abfe31" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:16:08 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b6cc392a-cae6-4236-9af9-429eb4657b91 tempest-VolumeTypesAccessTest-1968370931 None] Lock "cinder-quobyte-1afa2af3-ed6f-4da7-a848-67a583abfe31" acquired by "delete_volume" :: waited 0.025s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:16:08 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[010e6624-83a3-4dcb-bdf6-2c7db4257f31]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:16:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b6cc392a-cae6-4236-9af9-429eb4657b91 tempest-VolumeTypesAccessTest-1968370931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1afa2af3-ed6f-4da7-a848-67a583abfe31 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:08 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1afa2af3-ed6f-4da7-a848-67a583abfe31 Nov 03 13:16:08 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:08 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b6cc392a-cae6-4236-9af9-429eb4657b91 tempest-VolumeTypesAccessTest-1968370931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1afa2af3-ed6f-4da7-a848-67a583abfe31" returned: 0 in 0.456s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b6cc392a-cae6-4236-9af9-429eb4657b91 tempest-VolumeTypesAccessTest-1968370931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1afa2af3-ed6f-4da7-a848-67a583abfe31 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:08 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1afa2af3-ed6f-4da7-a848-67a583abfe31 Nov 03 13:16:08 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:08 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b6cc392a-cae6-4236-9af9-429eb4657b91 tempest-VolumeTypesAccessTest-1968370931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1afa2af3-ed6f-4da7-a848-67a583abfe31" returned: 0 in 0.279s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:08 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b6cc392a-cae6-4236-9af9-429eb4657b91 tempest-VolumeTypesAccessTest-1968370931 None] Lock "cinder-quobyte-1afa2af3-ed6f-4da7-a848-67a583abfe31" released by "delete_volume" :: held 0.821s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:16:08 devstack cinder-volume[86725]: WARNING cinder.quota [None req-b6cc392a-cae6-4236-9af9-429eb4657b91 tempest-VolumeTypesAccessTest-1968370931 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-470308506 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-470308506, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:16:08 devstack cinder-volume[86725]: WARNING cinder.quota [None req-b6cc392a-cae6-4236-9af9-429eb4657b91 tempest-VolumeTypesAccessTest-1968370931 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-470308506 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-470308506, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:16:08 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-b6cc392a-cae6-4236-9af9-429eb4657b91 tempest-VolumeTypesAccessTest-1968370931 None] Created reservations ['def6ce31-da58-4a6a-a932-3502d4d04f46', 'e299c68b-e622-4fdb-a186-9b7b6d445560', 'b8615a8a-3155-479d-a99b-61130b23ebf5', '725e36e7-c092-438a-b258-0b883628fcdf'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:16:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b6cc392a-cae6-4236-9af9-429eb4657b91 tempest-VolumeTypesAccessTest-1968370931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:16:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b6cc392a-cae6-4236-9af9-429eb4657b91 tempest-VolumeTypesAccessTest-1968370931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:16:09 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b6cc392a-cae6-4236-9af9-429eb4657b91 tempest-VolumeTypesAccessTest-1968370931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:16:09 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b6cc392a-cae6-4236-9af9-429eb4657b91 tempest-VolumeTypesAccessTest-1968370931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:16:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b6cc392a-cae6-4236-9af9-429eb4657b91 tempest-VolumeTypesAccessTest-1968370931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:16:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b6cc392a-cae6-4236-9af9-429eb4657b91 tempest-VolumeTypesAccessTest-1968370931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:09 devstack sudo[98184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:16:09 devstack sudo[98184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:09 devstack sudo[98184]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b6cc392a-cae6-4236-9af9-429eb4657b91 tempest-VolumeTypesAccessTest-1968370931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.404s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:09 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-b6cc392a-cae6-4236-9af9-429eb4657b91 tempest-VolumeTypesAccessTest-1968370931 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:16:09 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-b6cc392a-cae6-4236-9af9-429eb4657b91 tempest-VolumeTypesAccessTest-1968370931 None] Deleted volume successfully. Nov 03 13:16:09 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b6cc392a-cae6-4236-9af9-429eb4657b91 tempest-VolumeTypesAccessTest-1968370931 None] Lock "cinder-1afa2af3-ed6f-4da7-a848-67a583abfe31-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:16:10 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-87b2eabf-ce8c-49c0-a0a4-93ef6f7bc9d0 tempest-VolumesNegativeTest-2038583748 None] Acquiring lock "cinder-3fdbd2cc-f1bd-416d-9d73-64dab1d38f65-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:16:10 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-87b2eabf-ce8c-49c0-a0a4-93ef6f7bc9d0 tempest-VolumesNegativeTest-2038583748 None] Lock "cinder-3fdbd2cc-f1bd-416d-9d73-64dab1d38f65-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:16:10 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-87b2eabf-ce8c-49c0-a0a4-93ef6f7bc9d0 tempest-VolumesNegativeTest-2038583748 None] Acquiring lock "cinder-quobyte-3fdbd2cc-f1bd-416d-9d73-64dab1d38f65" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:16:10 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-87b2eabf-ce8c-49c0-a0a4-93ef6f7bc9d0 tempest-VolumesNegativeTest-2038583748 None] Lock "cinder-quobyte-3fdbd2cc-f1bd-416d-9d73-64dab1d38f65" acquired by "delete_volume" :: waited 0.031s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:16:10 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac8faa3-39f8-4e09-9188-d5e97224d408]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:16:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-87b2eabf-ce8c-49c0-a0a4-93ef6f7bc9d0 tempest-VolumesNegativeTest-2038583748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3fdbd2cc-f1bd-416d-9d73-64dab1d38f65 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:11 devstack sudo[98187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3fdbd2cc-f1bd-416d-9d73-64dab1d38f65 Nov 03 13:16:11 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:11 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-87b2eabf-ce8c-49c0-a0a4-93ef6f7bc9d0 tempest-VolumesNegativeTest-2038583748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3fdbd2cc-f1bd-416d-9d73-64dab1d38f65" returned: 0 in 0.493s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-87b2eabf-ce8c-49c0-a0a4-93ef6f7bc9d0 tempest-VolumesNegativeTest-2038583748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3fdbd2cc-f1bd-416d-9d73-64dab1d38f65 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:11 devstack sudo[98193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3fdbd2cc-f1bd-416d-9d73-64dab1d38f65 Nov 03 13:16:11 devstack sudo[98193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:11 devstack sudo[98193]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-87b2eabf-ce8c-49c0-a0a4-93ef6f7bc9d0 tempest-VolumesNegativeTest-2038583748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3fdbd2cc-f1bd-416d-9d73-64dab1d38f65" returned: 0 in 0.304s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:11 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-87b2eabf-ce8c-49c0-a0a4-93ef6f7bc9d0 tempest-VolumesNegativeTest-2038583748 None] Lock "cinder-quobyte-3fdbd2cc-f1bd-416d-9d73-64dab1d38f65" released by "delete_volume" :: held 0.878s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:16:11 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-87b2eabf-ce8c-49c0-a0a4-93ef6f7bc9d0 tempest-VolumesNegativeTest-2038583748 None] Created reservations ['bedce7b5-ebf5-495a-afd2-65ef5c2fe1dc', 'f9c07d8a-aff5-4382-bb22-dac0c10c95de', 'a4a48c19-965d-4b3c-90eb-4300ddea5c34', 'bbf57266-3e36-44ed-8a38-7ec0b4aba970'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:16:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-87b2eabf-ce8c-49c0-a0a4-93ef6f7bc9d0 tempest-VolumesNegativeTest-2038583748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:16:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-87b2eabf-ce8c-49c0-a0a4-93ef6f7bc9d0 tempest-VolumesNegativeTest-2038583748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:16:11 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-87b2eabf-ce8c-49c0-a0a4-93ef6f7bc9d0 tempest-VolumesNegativeTest-2038583748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:16:11 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-87b2eabf-ce8c-49c0-a0a4-93ef6f7bc9d0 tempest-VolumesNegativeTest-2038583748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:16:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-87b2eabf-ce8c-49c0-a0a4-93ef6f7bc9d0 tempest-VolumesNegativeTest-2038583748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:16:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-87b2eabf-ce8c-49c0-a0a4-93ef6f7bc9d0 tempest-VolumesNegativeTest-2038583748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:11 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:16:11 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:12 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-87b2eabf-ce8c-49c0-a0a4-93ef6f7bc9d0 tempest-VolumesNegativeTest-2038583748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.319s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:12 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-87b2eabf-ce8c-49c0-a0a4-93ef6f7bc9d0 tempest-VolumesNegativeTest-2038583748 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:16:12 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-87b2eabf-ce8c-49c0-a0a4-93ef6f7bc9d0 tempest-VolumesNegativeTest-2038583748 None] Deleted volume successfully. Nov 03 13:16:12 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-87b2eabf-ce8c-49c0-a0a4-93ef6f7bc9d0 tempest-VolumesNegativeTest-2038583748 None] Lock "cinder-3fdbd2cc-f1bd-416d-9d73-64dab1d38f65-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:16:12 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:16:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] Flow 'volume_create_manager' (395955c0-eb08-4e38-b004-1c0bca1e7a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:16:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ec1ef5-cd3d-4cd3-87e3-62c34bb7ec6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ec1ef5-cd3d-4cd3-87e3-62c34bb7ec6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1840550524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e772cb5-8494-4bc2-bf24-3a0a2798d9c4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='465f411b6d75465fac3c0e8110706faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:16:13Z,use_quota=True,user_id='26cfa91320444611aaa668c6ac09994f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9317270f-8a81-4520-9ec2-39159024ee49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9317270f-8a81-4520-9ec2-39159024ee49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96fc5bb-54f6-46c5-a635-858926d911e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96fc5bb-54f6-46c5-a635-858926d911e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e772cb5-8494-4bc2-bf24-3a0a2798d9c4', 'volume_name': 'volume-7e772cb5-8494-4bc2-bf24-3a0a2798d9c4', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f9a21a-0aa1-4adf-91f3-9e7b7ff01766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f9a21a-0aa1-4adf-91f3-9e7b7ff01766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77468df3-6979-4151-906b-3e9d7639fa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:13 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] Volume 7e772cb5-8494-4bc2-bf24-3a0a2798d9c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e772cb5-8494-4bc2-bf24-3a0a2798d9c4', 'volume_size': 1} Nov 03 13:16:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:16:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:16:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1840550524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e772cb5-8494-4bc2-bf24-3a0a2798d9c4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='465f411b6d75465fac3c0e8110706faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:16:13Z,use_quota=True,user_id='26cfa91320444611aaa668c6ac09994f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:16:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] Creating volume 7e772cb5-8494-4bc2-bf24-3a0a2798d9c4 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:16:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:16:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:16:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:16:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:16:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:16:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:16:13 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:16:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7e772cb5-8494-4bc2-bf24-3a0a2798d9c4 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:13 devstack sudo[98199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7e772cb5-8494-4bc2-bf24-3a0a2798d9c4 1073741824 Nov 03 13:16:13 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:13 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7e772cb5-8494-4bc2-bf24-3a0a2798d9c4 1073741824" returned: 0 in 0.548s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7e772cb5-8494-4bc2-bf24-3a0a2798d9c4 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:13 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7e772cb5-8494-4bc2-bf24-3a0a2798d9c4 Nov 03 13:16:13 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:13 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7e772cb5-8494-4bc2-bf24-3a0a2798d9c4" returned: 0 in 0.355s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:16:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:16:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77468df3-6979-4151-906b-3e9d7639fa4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e772cb5-8494-4bc2-bf24-3a0a2798d9c4', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2af11d9d-2434-4ae5-b513-82f7abad3fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:14 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] Volume volume-7e772cb5-8494-4bc2-bf24-3a0a2798d9c4 (7e772cb5-8494-4bc2-bf24-3a0a2798d9c4): created successfully Nov 03 13:16:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2af11d9d-2434-4ae5-b513-82f7abad3fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] Flow 'volume_create_manager' (395955c0-eb08-4e38-b004-1c0bca1e7a03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:16:14 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-e0035429-9c8a-4fef-8c98-652c16f09c69 req-bb342b9a-a3af-44ea-91b3-7741aa973f81 tempest-VolumesGetTestJSON-975430167 None] Created volume successfully. Nov 03 13:16:15 devstack cinder-volume[86725]: DEBUG cinder.coordination [req-9b2f27fc-e2e9-481c-a102-52f7948beb1d req-7249e092-dbc6-417f-a357-a5e8c674480e tempest-VolumesGetTestJSON-975430167 None] Acquiring lock "cinder-7e772cb5-8494-4bc2-bf24-3a0a2798d9c4-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:16:15 devstack cinder-volume[86725]: DEBUG cinder.coordination [req-9b2f27fc-e2e9-481c-a102-52f7948beb1d req-7249e092-dbc6-417f-a357-a5e8c674480e tempest-VolumesGetTestJSON-975430167 None] Lock "cinder-7e772cb5-8494-4bc2-bf24-3a0a2798d9c4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:16:15 devstack cinder-volume[86725]: DEBUG cinder.coordination [req-9b2f27fc-e2e9-481c-a102-52f7948beb1d req-7249e092-dbc6-417f-a357-a5e8c674480e tempest-VolumesGetTestJSON-975430167 None] Acquiring lock "cinder-quobyte-7e772cb5-8494-4bc2-bf24-3a0a2798d9c4" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:16:15 devstack cinder-volume[86725]: DEBUG cinder.coordination [req-9b2f27fc-e2e9-481c-a102-52f7948beb1d req-7249e092-dbc6-417f-a357-a5e8c674480e tempest-VolumesGetTestJSON-975430167 None] Lock "cinder-quobyte-7e772cb5-8494-4bc2-bf24-3a0a2798d9c4" acquired by "delete_volume" :: waited 0.029s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:16:15 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d624b19-558f-465f-98b4-6305169cc2e6]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:16:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-9b2f27fc-e2e9-481c-a102-52f7948beb1d req-7249e092-dbc6-417f-a357-a5e8c674480e tempest-VolumesGetTestJSON-975430167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7e772cb5-8494-4bc2-bf24-3a0a2798d9c4 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:15 devstack sudo[98209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7e772cb5-8494-4bc2-bf24-3a0a2798d9c4 Nov 03 13:16:15 devstack sudo[98209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:16 devstack sudo[98209]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-9b2f27fc-e2e9-481c-a102-52f7948beb1d req-7249e092-dbc6-417f-a357-a5e8c674480e tempest-VolumesGetTestJSON-975430167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7e772cb5-8494-4bc2-bf24-3a0a2798d9c4" returned: 0 in 0.519s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-9b2f27fc-e2e9-481c-a102-52f7948beb1d req-7249e092-dbc6-417f-a357-a5e8c674480e tempest-VolumesGetTestJSON-975430167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7e772cb5-8494-4bc2-bf24-3a0a2798d9c4 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:16 devstack sudo[98214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7e772cb5-8494-4bc2-bf24-3a0a2798d9c4 Nov 03 13:16:16 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:16 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-9b2f27fc-e2e9-481c-a102-52f7948beb1d req-7249e092-dbc6-417f-a357-a5e8c674480e tempest-VolumesGetTestJSON-975430167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7e772cb5-8494-4bc2-bf24-3a0a2798d9c4" returned: 0 in 0.299s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:16 devstack cinder-volume[86725]: DEBUG cinder.coordination [req-9b2f27fc-e2e9-481c-a102-52f7948beb1d req-7249e092-dbc6-417f-a357-a5e8c674480e tempest-VolumesGetTestJSON-975430167 None] Lock "cinder-quobyte-7e772cb5-8494-4bc2-bf24-3a0a2798d9c4" released by "delete_volume" :: held 0.891s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:16:16 devstack cinder-volume[86725]: DEBUG cinder.quota [req-9b2f27fc-e2e9-481c-a102-52f7948beb1d req-7249e092-dbc6-417f-a357-a5e8c674480e tempest-VolumesGetTestJSON-975430167 None] Created reservations ['c9b71c58-31a8-4dce-9906-51b868337cb1', '91eccc4a-cd50-48b3-ab6a-d9c3fa1148a0', '01eb7b78-7702-40ac-a982-4283562d7fd9', '400e3c61-2504-4cb1-b176-646d092270c0'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:16:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-9b2f27fc-e2e9-481c-a102-52f7948beb1d req-7249e092-dbc6-417f-a357-a5e8c674480e tempest-VolumesGetTestJSON-975430167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:16:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-9b2f27fc-e2e9-481c-a102-52f7948beb1d req-7249e092-dbc6-417f-a357-a5e8c674480e tempest-VolumesGetTestJSON-975430167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:16:16 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [req-9b2f27fc-e2e9-481c-a102-52f7948beb1d req-7249e092-dbc6-417f-a357-a5e8c674480e tempest-VolumesGetTestJSON-975430167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:16:16 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [req-9b2f27fc-e2e9-481c-a102-52f7948beb1d req-7249e092-dbc6-417f-a357-a5e8c674480e tempest-VolumesGetTestJSON-975430167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:16:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-9b2f27fc-e2e9-481c-a102-52f7948beb1d req-7249e092-dbc6-417f-a357-a5e8c674480e tempest-VolumesGetTestJSON-975430167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:16:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-9b2f27fc-e2e9-481c-a102-52f7948beb1d req-7249e092-dbc6-417f-a357-a5e8c674480e tempest-VolumesGetTestJSON-975430167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:16 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:16:16 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:17 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-9b2f27fc-e2e9-481c-a102-52f7948beb1d req-7249e092-dbc6-417f-a357-a5e8c674480e tempest-VolumesGetTestJSON-975430167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.365s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:17 devstack cinder-volume[86725]: DEBUG cinder.manager [req-9b2f27fc-e2e9-481c-a102-52f7948beb1d req-7249e092-dbc6-417f-a357-a5e8c674480e tempest-VolumesGetTestJSON-975430167 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:16:17 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-9b2f27fc-e2e9-481c-a102-52f7948beb1d req-7249e092-dbc6-417f-a357-a5e8c674480e tempest-VolumesGetTestJSON-975430167 None] Deleted volume successfully. Nov 03 13:16:17 devstack cinder-volume[86725]: DEBUG cinder.coordination [req-9b2f27fc-e2e9-481c-a102-52f7948beb1d req-7249e092-dbc6-417f-a357-a5e8c674480e tempest-VolumesGetTestJSON-975430167 None] Lock "cinder-7e772cb5-8494-4bc2-bf24-3a0a2798d9c4-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:16:22 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:16:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] Flow 'volume_create_manager' (93a13c56-5ce2-4a81-b5c2-7ef4f50b91e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:16:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26e57085-d211-4761-859a-27fa1d4e56c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26e57085-d211-4761-859a-27fa1d4e56c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-900893380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c7efa9d-bd3a-4f8f-b9c4-6a9bc8666869,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d51b2fa3b64546489d53de7249522629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:16:22Z,use_quota=True,user_id='aaff01a52bc740bfb5bb4e2a69bad3cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0604d14e-caac-4e9e-a7b9-883087864be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0604d14e-caac-4e9e-a7b9-883087864be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb7e8e15-a092-479a-a4af-a1b2f77341db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb7e8e15-a092-479a-a4af-a1b2f77341db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c7efa9d-bd3a-4f8f-b9c4-6a9bc8666869', 'volume_name': 'volume-9c7efa9d-bd3a-4f8f-b9c4-6a9bc8666869', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4fc410f-ded5-4f85-8872-828435989a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4fc410f-ded5-4f85-8872-828435989a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd5b7d27-2bc2-4ac8-ba53-f73b05da8d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:22 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] Volume 9c7efa9d-bd3a-4f8f-b9c4-6a9bc8666869: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c7efa9d-bd3a-4f8f-b9c4-6a9bc8666869', 'volume_size': 1} Nov 03 13:16:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:16:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:16:22 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-900893380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c7efa9d-bd3a-4f8f-b9c4-6a9bc8666869,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d51b2fa3b64546489d53de7249522629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:16:22Z,use_quota=True,user_id='aaff01a52bc740bfb5bb4e2a69bad3cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:16:22 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] Creating volume 9c7efa9d-bd3a-4f8f-b9c4-6a9bc8666869 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:16:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:16:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:16:22 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:16:22 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:16:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:16:22 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:16:22 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:16:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9c7efa9d-bd3a-4f8f-b9c4-6a9bc8666869 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:22 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9c7efa9d-bd3a-4f8f-b9c4-6a9bc8666869 1073741824 Nov 03 13:16:22 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:22 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9c7efa9d-bd3a-4f8f-b9c4-6a9bc8666869 1073741824" returned: 0 in 0.615s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9c7efa9d-bd3a-4f8f-b9c4-6a9bc8666869 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:22 devstack sudo[98231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9c7efa9d-bd3a-4f8f-b9c4-6a9bc8666869 Nov 03 13:16:22 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:23 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9c7efa9d-bd3a-4f8f-b9c4-6a9bc8666869" returned: 0 in 0.350s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:23 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:16:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:16:23 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd5b7d27-2bc2-4ac8-ba53-f73b05da8d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c7efa9d-bd3a-4f8f-b9c4-6a9bc8666869', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:23 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec34ea20-16c5-4382-a937-006f9687a1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:23 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] Volume volume-9c7efa9d-bd3a-4f8f-b9c4-6a9bc8666869 (9c7efa9d-bd3a-4f8f-b9c4-6a9bc8666869): created successfully Nov 03 13:16:23 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec34ea20-16c5-4382-a937-006f9687a1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:23 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] Flow 'volume_create_manager' (93a13c56-5ce2-4a81-b5c2-7ef4f50b91e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:16:23 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-69d16e2e-e78a-46b8-af37-61f3bfc5666a tempest-VolumesTestJSON-499702340 None] Created volume successfully. Nov 03 13:16:24 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:16:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Flow 'volume_create_manager' (329dcad2-ab11-4f95-8d10-5ba61510a921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:16:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc48110f-a623-4991-858e-ffab7d2ed3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc48110f-a623-4991-858e-ffab7d2ed3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1312922683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52fe2414-fdf6-4522-a7fe-33776c0423c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fba7e28c08fc48a6838873d3de5bb926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:16:24Z,use_quota=True,user_id='b2f7e3c319ba498d962b9f4f248be80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dada074-0269-4129-8246-68c7da2f18e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dada074-0269-4129-8246-68c7da2f18e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05f3f834-1b5c-4a0e-8f25-f86e1d38450d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:24 devstack cinder-volume[86725]: DEBUG cinder.image.glance [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Creating Keystone auth plugin from conf {{(pid=86725) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 13:16:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05f3f834-1b5c-4a0e-8f25-f86e1d38450d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '52fe2414-fdf6-4522-a7fe-33776c0423c9', 'volume_name': 'volume-52fe2414-fdf6-4522-a7fe-33776c0423c9', 'volume_size': 1, 'image_id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8a9fdfe427f436894d9c81085f9b6d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'created_at': datetime.datetime(2026, 11, 3, 12, 0, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 0, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa44f50f-02e0-4b4c-82f4-dd412b913b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa44f50f-02e0-4b4c-82f4-dd412b913b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb55e333-f00b-4aae-970d-f8312563a5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:25 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Volume 52fe2414-fdf6-4522-a7fe-33776c0423c9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-52fe2414-fdf6-4522-a7fe-33776c0423c9', 'volume_size': 1, 'image_id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8a9fdfe427f436894d9c81085f9b6d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'created_at': datetime.datetime(2026, 11, 3, 12, 0, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 0, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 13:16:25 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Trying to clone 52fe2414-fdf6-4522-a7fe-33776c0423c9 from image d23bcc2f-7dfc-45dc-b259-aec67f909b4f at location (None, [{'url': 'file:///opt/stack/data/glance/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'metadata': {}}]). {{(pid=86725) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 13:16:25 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:16:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] Flow 'volume_create_manager' (3410b7d3-3164-4d0d-8b4b-b9161ddde191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:16:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (575bb3b5-0f0a-45f0-9d9f-44d5d5992909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (575bb3b5-0f0a-45f0-9d9f-44d5d5992909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1087140206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=095c9f31-0e97-4d79-8bd7-57c04419152e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d51b2fa3b64546489d53de7249522629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:16:25Z,use_quota=True,user_id='aaff01a52bc740bfb5bb4e2a69bad3cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62a20f21-4622-40d4-a951-a7b385bc8c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62a20f21-4622-40d4-a951-a7b385bc8c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25ea6f8-7b03-4b29-90d9-e20475a7d569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25ea6f8-7b03-4b29-90d9-e20475a7d569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '095c9f31-0e97-4d79-8bd7-57c04419152e', 'volume_name': 'volume-095c9f31-0e97-4d79-8bd7-57c04419152e', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8fe962e-e6c9-4d74-948c-760de2f09140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8fe962e-e6c9-4d74-948c-760de2f09140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87efff1b-91cb-47c6-8f29-b9e2695b2a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:25 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] Volume 095c9f31-0e97-4d79-8bd7-57c04419152e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-095c9f31-0e97-4d79-8bd7-57c04419152e', 'volume_size': 1} Nov 03 13:16:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:16:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:16:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1087140206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=095c9f31-0e97-4d79-8bd7-57c04419152e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d51b2fa3b64546489d53de7249522629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:16:25Z,use_quota=True,user_id='aaff01a52bc740bfb5bb4e2a69bad3cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:16:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] Creating volume 095c9f31-0e97-4d79-8bd7-57c04419152e {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:16:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:16:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:16:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:16:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:16:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:16:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:16:25 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:16:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-095c9f31-0e97-4d79-8bd7-57c04419152e 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:25 devstack sudo[98251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-095c9f31-0e97-4d79-8bd7-57c04419152e 1073741824 Nov 03 13:16:25 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:25 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_kkteyegjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86725) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 13:16:25 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Image download 20.69 MB at 20.69 MB/s Nov 03 13:16:25 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f931a8-896e-4cf5-90dd-e6d34cac419f]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:16:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_kkteyegjdevstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:25 devstack sudo[98258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_kkteyegjdevstack@QuobyteHD Nov 03 13:16:25 devstack sudo[98258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:25 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-095c9f31-0e97-4d79-8bd7-57c04419152e 1073741824" returned: 0 in 0.735s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-095c9f31-0e97-4d79-8bd7-57c04419152e {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:26 devstack sudo[98260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-095c9f31-0e97-4d79-8bd7-57c04419152e Nov 03 13:16:26 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:26 devstack sudo[98258]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_kkteyegjdevstack@QuobyteHD" returned: 0 in 0.534s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:26 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Temporary image d23bcc2f-7dfc-45dc-b259-aec67f909b4f is fetched for user b2f7e3c319ba498d962b9f4f248be80f. {{(pid=86725) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 13:16:26 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edf7780-8e58-4791-bde1-35c56e7475cc]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:16:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_kkteyegjdevstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:26 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-095c9f31-0e97-4d79-8bd7-57c04419152e" returned: 0 in 0.373s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:16:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:16:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87efff1b-91cb-47c6-8f29-b9e2695b2a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-095c9f31-0e97-4d79-8bd7-57c04419152e', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (956ac419-c759-4bc6-949a-20abd87c66ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:26 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] Volume volume-095c9f31-0e97-4d79-8bd7-57c04419152e (095c9f31-0e97-4d79-8bd7-57c04419152e): created successfully Nov 03 13:16:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (956ac419-c759-4bc6-949a-20abd87c66ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] Flow 'volume_create_manager' (3410b7d3-3164-4d0d-8b4b-b9161ddde191) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:16:26 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-967e7026-7b09-4870-a4fb-c718b467c91c tempest-VolumesTestJSON-499702340 None] Created volume successfully. Nov 03 13:16:26 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_kkteyegjdevstack@QuobyteHD Nov 03 13:16:26 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:26 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_kkteyegjdevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:16:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:16:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1312922683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52fe2414-fdf6-4522-a7fe-33776c0423c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fba7e28c08fc48a6838873d3de5bb926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:16:24Z,use_quota=True,user_id='b2f7e3c319ba498d962b9f4f248be80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:16:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Creating volume 52fe2414-fdf6-4522-a7fe-33776c0423c9 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:16:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:16:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:16:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:16:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:16:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:16:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:16:26 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:16:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-52fe2414-fdf6-4522-a7fe-33776c0423c9 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:26 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-52fe2414-fdf6-4522-a7fe-33776c0423c9 1073741824 Nov 03 13:16:26 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:27 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-52fe2414-fdf6-4522-a7fe-33776c0423c9 1073741824" returned: 0 in 0.641s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-52fe2414-fdf6-4522-a7fe-33776c0423c9 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:27 devstack sudo[98278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-52fe2414-fdf6-4522-a7fe-33776c0423c9 Nov 03 13:16:27 devstack sudo[98278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:27 devstack sudo[98278]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-52fe2414-fdf6-4522-a7fe-33776c0423c9" returned: 0 in 0.422s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:27 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:16:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:16:27 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:16:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] Flow 'volume_create_manager' (d50dd746-f767-4843-a350-47ba0350a56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:16:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc28572-9abe-4d31-a9dd-c203f1197a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc28572-9abe-4d31-a9dd-c203f1197a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:16:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2051774758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d26411dd-8fa0-45ea-a6b3-e37ef4435aa5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d51b2fa3b64546489d53de7249522629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:16:28Z,use_quota=True,user_id='aaff01a52bc740bfb5bb4e2a69bad3cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a10da6-ed99-4361-9bec-4761f0793126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a10da6-ed99-4361-9bec-4761f0793126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c10c429-262a-47e8-a3b5-54183f7e5bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c10c429-262a-47e8-a3b5-54183f7e5bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd26411dd-8fa0-45ea-a6b3-e37ef4435aa5', 'volume_name': 'volume-d26411dd-8fa0-45ea-a6b3-e37ef4435aa5', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3451850c-e9cb-4370-8fda-781d211b966d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3451850c-e9cb-4370-8fda-781d211b966d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1e5a65a-e022-4424-bd7c-9f88d5b07abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:27 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] Volume d26411dd-8fa0-45ea-a6b3-e37ef4435aa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d26411dd-8fa0-45ea-a6b3-e37ef4435aa5', 'volume_size': 1} Nov 03 13:16:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:16:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:16:27 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:16:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2051774758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d26411dd-8fa0-45ea-a6b3-e37ef4435aa5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d51b2fa3b64546489d53de7249522629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:16:28Z,use_quota=True,user_id='aaff01a52bc740bfb5bb4e2a69bad3cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:16:27 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] Creating volume d26411dd-8fa0-45ea-a6b3-e37ef4435aa5 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:16:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:16:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:16:27 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:16:27 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:16:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:16:27 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:16:27 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:16:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d26411dd-8fa0-45ea-a6b3-e37ef4435aa5 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:28 devstack cinder-volume[86725]: DEBUG cinder.volume.volume_utils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Attempting download of d23bcc2f-7dfc-45dc-b259-aec67f909b4f ((None, [{'url': 'file:///opt/stack/data/glance/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'metadata': {}}])) to volume 52fe2414-fdf6-4522-a7fe-33776c0423c9. {{(pid=86725) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 13:16:28 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d26411dd-8fa0-45ea-a6b3-e37ef4435aa5 1073741824 Nov 03 13:16:28 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:28 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d73746-66ea-4f57-8ce9-5162b701f7ed]: (4, 'raw') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:16:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_ue8z7l6i {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:28 devstack sudo[98283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_ue8z7l6i Nov 03 13:16:28 devstack sudo[98283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:28 devstack sudo[98283]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_ue8z7l6i" returned: 0 in 0.402s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_ue8z7l6i {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:28 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d26411dd-8fa0-45ea-a6b3-e37ef4435aa5 1073741824" returned: 0 in 0.631s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:28 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_ue8z7l6i Nov 03 13:16:28 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d26411dd-8fa0-45ea-a6b3-e37ef4435aa5 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:28 devstack sudo[98293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d26411dd-8fa0-45ea-a6b3-e37ef4435aa5 Nov 03 13:16:28 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:28 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d26411dd-8fa0-45ea-a6b3-e37ef4435aa5" returned: 0 in 0.331s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:28 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:16:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:16:28 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:29 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1e5a65a-e022-4424-bd7c-9f88d5b07abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d26411dd-8fa0-45ea-a6b3-e37ef4435aa5', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:29 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dbb0f96-1aea-4f09-b796-5ecfed0d5d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_ue8z7l6i" returned: 1 in 0.536s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_ue8z7l6i' failed. Not Retrying. {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:16:29 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[c103dde1-d8f8-4e22-bf00-9d34c579d782]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:16:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_kkteyegjdevstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:29 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] Volume volume-d26411dd-8fa0-45ea-a6b3-e37ef4435aa5 (d26411dd-8fa0-45ea-a6b3-e37ef4435aa5): created successfully Nov 03 13:16:29 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dbb0f96-1aea-4f09-b796-5ecfed0d5d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:29 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] Flow 'volume_create_manager' (d50dd746-f767-4843-a350-47ba0350a56f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:16:29 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-709eb2aa-8bc0-4ece-8aa6-d8409a6341fe tempest-VolumesTestJSON-499702340 None] Created volume successfully. Nov 03 13:16:29 devstack sudo[98298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_kkteyegjdevstack@QuobyteHD Nov 03 13:16:29 devstack sudo[98298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:29 devstack sudo[98298]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_kkteyegjdevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:29 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] d23bcc2f-7dfc-45dc-b259-aec67f909b4f was qcow2, converting to qcow2 {{(pid=86725) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 13:16:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_kkteyegjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-52fe2414-fdf6-4522-a7fe-33776c0423c9 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:29 devstack sudo[98303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_kkteyegjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-52fe2414-fdf6-4522-a7fe-33776c0423c9 Nov 03 13:16:29 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:31 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c3acca6f-cff5-470b-beee-36b6f339cc7c tempest-VolumesTestJSON-499702340 None] Acquiring lock "cinder-d26411dd-8fa0-45ea-a6b3-e37ef4435aa5-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:16:31 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c3acca6f-cff5-470b-beee-36b6f339cc7c tempest-VolumesTestJSON-499702340 None] Lock "cinder-d26411dd-8fa0-45ea-a6b3-e37ef4435aa5-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:16:31 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c3acca6f-cff5-470b-beee-36b6f339cc7c tempest-VolumesTestJSON-499702340 None] Acquiring lock "cinder-quobyte-d26411dd-8fa0-45ea-a6b3-e37ef4435aa5" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:16:31 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c3acca6f-cff5-470b-beee-36b6f339cc7c tempest-VolumesTestJSON-499702340 None] Lock "cinder-quobyte-d26411dd-8fa0-45ea-a6b3-e37ef4435aa5" acquired by "delete_volume" :: waited 0.049s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:16:31 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa33960-5ad0-4481-ad3b-45896f2152f3]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:16:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c3acca6f-cff5-470b-beee-36b6f339cc7c tempest-VolumesTestJSON-499702340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d26411dd-8fa0-45ea-a6b3-e37ef4435aa5 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:32 devstack sudo[98312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d26411dd-8fa0-45ea-a6b3-e37ef4435aa5 Nov 03 13:16:32 devstack sudo[98312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:32 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_kkteyegjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-52fe2414-fdf6-4522-a7fe-33776c0423c9" returned: 0 in 3.273s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:32 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_kkteyegjdevstack@QuobyteHD, size 112.00 MB, duration 3.27 sec, destination /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-52fe2414-fdf6-4522-a7fe-33776c0423c9 {{(pid=86725) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:16:32 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Converted 112.00 MB image at 34.20 MB/s Nov 03 13:16:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-52fe2414-fdf6-4522-a7fe-33776c0423c9 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:32 devstack sudo[98312]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c3acca6f-cff5-470b-beee-36b6f339cc7c tempest-VolumesTestJSON-499702340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d26411dd-8fa0-45ea-a6b3-e37ef4435aa5" returned: 0 in 0.791s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c3acca6f-cff5-470b-beee-36b6f339cc7c tempest-VolumesTestJSON-499702340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d26411dd-8fa0-45ea-a6b3-e37ef4435aa5 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:32 devstack sudo[98353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-52fe2414-fdf6-4522-a7fe-33776c0423c9 1G Nov 03 13:16:32 devstack sudo[98353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:32 devstack sudo[98355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d26411dd-8fa0-45ea-a6b3-e37ef4435aa5 Nov 03 13:16:32 devstack sudo[98355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:33 devstack sudo[98355]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c3acca6f-cff5-470b-beee-36b6f339cc7c tempest-VolumesTestJSON-499702340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d26411dd-8fa0-45ea-a6b3-e37ef4435aa5" returned: 0 in 0.449s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:33 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c3acca6f-cff5-470b-beee-36b6f339cc7c tempest-VolumesTestJSON-499702340 None] Lock "cinder-quobyte-d26411dd-8fa0-45ea-a6b3-e37ef4435aa5" released by "delete_volume" :: held 1.347s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:16:33 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-c3acca6f-cff5-470b-beee-36b6f339cc7c tempest-VolumesTestJSON-499702340 None] Created reservations ['77efb202-c3f4-4220-92e6-6163c51c535f', '0cb0db9f-0a2e-4868-a5b2-208abb1b0fc7', '5f2adf31-6703-4a13-a5b8-6d75d6338cc8', 'cf9d04cc-95a9-40e8-a7b3-9ca02c4e25c5'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:16:33 devstack sudo[98353]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-52fe2414-fdf6-4522-a7fe-33776c0423c9 1G" returned: 0 in 0.694s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:33 devstack cinder-volume[86725]: DEBUG cinder.volume.volume_utils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Downloaded image d23bcc2f-7dfc-45dc-b259-aec67f909b4f ((None, [{'url': 'file:///opt/stack/data/glance/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'metadata': {}}])) to volume 52fe2414-fdf6-4522-a7fe-33776c0423c9 successfully. {{(pid=86725) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 13:16:33 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Temporary image d23bcc2f-7dfc-45dc-b259-aec67f909b4f for user b2f7e3c319ba498d962b9f4f248be80f is deleted. {{(pid=86725) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 13:16:33 devstack cinder-volume[86725]: DEBUG cinder.volume.volume_utils [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Marking volume 52fe2414-fdf6-4522-a7fe-33776c0423c9 as bootable. {{(pid=86725) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 13:16:33 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Copying metadata from image d23bcc2f-7dfc-45dc-b259-aec67f909b4f to 52fe2414-fdf6-4522-a7fe-33776c0423c9. {{(pid=86725) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 13:16:33 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Creating volume glance metadata for volume 52fe2414-fdf6-4522-a7fe-33776c0423c9 backed by image d23bcc2f-7dfc-45dc-b259-aec67f909b4f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86725) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 13:16:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c3acca6f-cff5-470b-beee-36b6f339cc7c tempest-VolumesTestJSON-499702340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:16:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c3acca6f-cff5-470b-beee-36b6f339cc7c tempest-VolumesTestJSON-499702340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:16:33 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-c3acca6f-cff5-470b-beee-36b6f339cc7c tempest-VolumesTestJSON-499702340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:16:33 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-c3acca6f-cff5-470b-beee-36b6f339cc7c tempest-VolumesTestJSON-499702340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:16:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c3acca6f-cff5-470b-beee-36b6f339cc7c tempest-VolumesTestJSON-499702340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:16:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c3acca6f-cff5-470b-beee-36b6f339cc7c tempest-VolumesTestJSON-499702340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:33 devstack sudo[98389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:16:33 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:33 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb55e333-f00b-4aae-970d-f8312563a5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52fe2414-fdf6-4522-a7fe-33776c0423c9', 'volume_size': 1, 'image_id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8a9fdfe427f436894d9c81085f9b6d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'created_at': datetime.datetime(2026, 11, 3, 12, 0, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 0, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:33 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44503c02-a402-4ab6-8b9a-381f007b4166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:33 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Volume volume-52fe2414-fdf6-4522-a7fe-33776c0423c9 (52fe2414-fdf6-4522-a7fe-33776c0423c9): created successfully Nov 03 13:16:33 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44503c02-a402-4ab6-8b9a-381f007b4166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:33 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Flow 'volume_create_manager' (329dcad2-ab11-4f95-8d10-5ba61510a921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:16:33 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-9e318393-e0a0-460a-9261-8bfed1ea013e tempest-VolumesImageMetadata-217992612 None] Created volume successfully. Nov 03 13:16:33 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c3acca6f-cff5-470b-beee-36b6f339cc7c tempest-VolumesTestJSON-499702340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.381s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:33 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-c3acca6f-cff5-470b-beee-36b6f339cc7c tempest-VolumesTestJSON-499702340 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:16:33 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-c3acca6f-cff5-470b-beee-36b6f339cc7c tempest-VolumesTestJSON-499702340 None] Deleted volume successfully. Nov 03 13:16:33 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c3acca6f-cff5-470b-beee-36b6f339cc7c tempest-VolumesTestJSON-499702340 None] Lock "cinder-d26411dd-8fa0-45ea-a6b3-e37ef4435aa5-delete_volume" released by "delete_volume" :: held 2.234s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:16:34 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a3e21d4f-cbfb-44b4-be0c-92784eeb856c tempest-VolumesTestJSON-499702340 None] Acquiring lock "cinder-095c9f31-0e97-4d79-8bd7-57c04419152e-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:16:34 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a3e21d4f-cbfb-44b4-be0c-92784eeb856c tempest-VolumesTestJSON-499702340 None] Lock "cinder-095c9f31-0e97-4d79-8bd7-57c04419152e-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:16:34 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a3e21d4f-cbfb-44b4-be0c-92784eeb856c tempest-VolumesTestJSON-499702340 None] Acquiring lock "cinder-quobyte-095c9f31-0e97-4d79-8bd7-57c04419152e" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:16:34 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a3e21d4f-cbfb-44b4-be0c-92784eeb856c tempest-VolumesTestJSON-499702340 None] Lock "cinder-quobyte-095c9f31-0e97-4d79-8bd7-57c04419152e" acquired by "delete_volume" :: waited 0.066s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:16:34 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[10908ae7-5d9e-4730-824a-789216d8b5fb]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:16:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a3e21d4f-cbfb-44b4-be0c-92784eeb856c tempest-VolumesTestJSON-499702340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-095c9f31-0e97-4d79-8bd7-57c04419152e {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:34 devstack sudo[98396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-095c9f31-0e97-4d79-8bd7-57c04419152e Nov 03 13:16:34 devstack sudo[98396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-55373c14-0a2d-4bc1-b0aa-03f12004517d tempest-VolumesImageMetadata-217992612 None] Acquiring lock "cinder-52fe2414-fdf6-4522-a7fe-33776c0423c9-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:16:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-55373c14-0a2d-4bc1-b0aa-03f12004517d tempest-VolumesImageMetadata-217992612 None] Lock "cinder-52fe2414-fdf6-4522-a7fe-33776c0423c9-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:16:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-55373c14-0a2d-4bc1-b0aa-03f12004517d tempest-VolumesImageMetadata-217992612 None] Acquiring lock "cinder-quobyte-52fe2414-fdf6-4522-a7fe-33776c0423c9" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:16:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-55373c14-0a2d-4bc1-b0aa-03f12004517d tempest-VolumesImageMetadata-217992612 None] Lock "cinder-quobyte-52fe2414-fdf6-4522-a7fe-33776c0423c9" acquired by "delete_volume" :: waited 0.025s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:16:35 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e27dfc8-2e93-4758-9fee-46d8b7d5c8b9]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:16:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-55373c14-0a2d-4bc1-b0aa-03f12004517d tempest-VolumesImageMetadata-217992612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-52fe2414-fdf6-4522-a7fe-33776c0423c9 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:35 devstack sudo[98396]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a3e21d4f-cbfb-44b4-be0c-92784eeb856c tempest-VolumesTestJSON-499702340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-095c9f31-0e97-4d79-8bd7-57c04419152e" returned: 0 in 0.768s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a3e21d4f-cbfb-44b4-be0c-92784eeb856c tempest-VolumesTestJSON-499702340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-095c9f31-0e97-4d79-8bd7-57c04419152e {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:35 devstack sudo[98403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-095c9f31-0e97-4d79-8bd7-57c04419152e Nov 03 13:16:35 devstack sudo[98403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:35 devstack sudo[98402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-52fe2414-fdf6-4522-a7fe-33776c0423c9 Nov 03 13:16:35 devstack sudo[98402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:35 devstack sudo[98403]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a3e21d4f-cbfb-44b4-be0c-92784eeb856c tempest-VolumesTestJSON-499702340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-095c9f31-0e97-4d79-8bd7-57c04419152e" returned: 0 in 0.368s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a3e21d4f-cbfb-44b4-be0c-92784eeb856c tempest-VolumesTestJSON-499702340 None] Lock "cinder-quobyte-095c9f31-0e97-4d79-8bd7-57c04419152e" released by "delete_volume" :: held 1.249s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:16:35 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-a3e21d4f-cbfb-44b4-be0c-92784eeb856c tempest-VolumesTestJSON-499702340 None] Created reservations ['5a7f789f-0678-4f45-a154-f321c14fa0c9', 'ee325012-9215-47f0-9314-33f747e9d2b5', '09c5fc06-d13d-41f2-ac6b-0e19e50c6b6b', 'f721247b-eb1b-4510-b55e-2fc302f6c4ef'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:16:35 devstack sudo[98402]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-55373c14-0a2d-4bc1-b0aa-03f12004517d tempest-VolumesImageMetadata-217992612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-52fe2414-fdf6-4522-a7fe-33776c0423c9" returned: 0 in 0.641s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-55373c14-0a2d-4bc1-b0aa-03f12004517d tempest-VolumesImageMetadata-217992612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-52fe2414-fdf6-4522-a7fe-33776c0423c9 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a3e21d4f-cbfb-44b4-be0c-92784eeb856c tempest-VolumesTestJSON-499702340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:16:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a3e21d4f-cbfb-44b4-be0c-92784eeb856c tempest-VolumesTestJSON-499702340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:16:35 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a3e21d4f-cbfb-44b4-be0c-92784eeb856c tempest-VolumesTestJSON-499702340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:16:35 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a3e21d4f-cbfb-44b4-be0c-92784eeb856c tempest-VolumesTestJSON-499702340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:16:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a3e21d4f-cbfb-44b4-be0c-92784eeb856c tempest-VolumesTestJSON-499702340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:16:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a3e21d4f-cbfb-44b4-be0c-92784eeb856c tempest-VolumesTestJSON-499702340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:35 devstack sudo[98411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-52fe2414-fdf6-4522-a7fe-33776c0423c9 Nov 03 13:16:35 devstack sudo[98411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:36 devstack sudo[98413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:16:36 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:36 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a3e21d4f-cbfb-44b4-be0c-92784eeb856c tempest-VolumesTestJSON-499702340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.351s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:36 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-a3e21d4f-cbfb-44b4-be0c-92784eeb856c tempest-VolumesTestJSON-499702340 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:16:36 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-a3e21d4f-cbfb-44b4-be0c-92784eeb856c tempest-VolumesTestJSON-499702340 None] Deleted volume successfully. Nov 03 13:16:36 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a3e21d4f-cbfb-44b4-be0c-92784eeb856c tempest-VolumesTestJSON-499702340 None] Lock "cinder-095c9f31-0e97-4d79-8bd7-57c04419152e-delete_volume" released by "delete_volume" :: held 2.135s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:16:36 devstack sudo[98411]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-55373c14-0a2d-4bc1-b0aa-03f12004517d tempest-VolumesImageMetadata-217992612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-52fe2414-fdf6-4522-a7fe-33776c0423c9" returned: 0 in 0.571s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:36 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-55373c14-0a2d-4bc1-b0aa-03f12004517d tempest-VolumesImageMetadata-217992612 None] Lock "cinder-quobyte-52fe2414-fdf6-4522-a7fe-33776c0423c9" released by "delete_volume" :: held 1.277s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:16:36 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-55373c14-0a2d-4bc1-b0aa-03f12004517d tempest-VolumesImageMetadata-217992612 None] Created reservations ['6de93ec8-37a0-46c0-a638-c72660a870e1', '6a5f054c-6cb0-46c4-842b-ef135b102ac1', 'f73da427-2fd4-4674-be1f-df5d6155c1a8', '72041e07-37dd-43d6-b306-07fc0ef560c6'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:16:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-55373c14-0a2d-4bc1-b0aa-03f12004517d tempest-VolumesImageMetadata-217992612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:16:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-55373c14-0a2d-4bc1-b0aa-03f12004517d tempest-VolumesImageMetadata-217992612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:16:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-55373c14-0a2d-4bc1-b0aa-03f12004517d tempest-VolumesImageMetadata-217992612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:16:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-55373c14-0a2d-4bc1-b0aa-03f12004517d tempest-VolumesImageMetadata-217992612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:16:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-55373c14-0a2d-4bc1-b0aa-03f12004517d tempest-VolumesImageMetadata-217992612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:16:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-55373c14-0a2d-4bc1-b0aa-03f12004517d tempest-VolumesImageMetadata-217992612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:36 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:16:36 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:36 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c1eae2db-465a-44b5-bfaf-762b4c850d23 tempest-VolumesTestJSON-499702340 None] Acquiring lock "cinder-9c7efa9d-bd3a-4f8f-b9c4-6a9bc8666869-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:16:36 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c1eae2db-465a-44b5-bfaf-762b4c850d23 tempest-VolumesTestJSON-499702340 None] Lock "cinder-9c7efa9d-bd3a-4f8f-b9c4-6a9bc8666869-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:16:36 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c1eae2db-465a-44b5-bfaf-762b4c850d23 tempest-VolumesTestJSON-499702340 None] Acquiring lock "cinder-quobyte-9c7efa9d-bd3a-4f8f-b9c4-6a9bc8666869" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:16:36 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c1eae2db-465a-44b5-bfaf-762b4c850d23 tempest-VolumesTestJSON-499702340 None] Lock "cinder-quobyte-9c7efa9d-bd3a-4f8f-b9c4-6a9bc8666869" acquired by "delete_volume" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:16:36 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9c31c1-0ad0-45a6-b974-80d9e986a1ca]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:16:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c1eae2db-465a-44b5-bfaf-762b4c850d23 tempest-VolumesTestJSON-499702340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9c7efa9d-bd3a-4f8f-b9c4-6a9bc8666869 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:37 devstack sudo[98419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9c7efa9d-bd3a-4f8f-b9c4-6a9bc8666869 Nov 03 13:16:37 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:37 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-55373c14-0a2d-4bc1-b0aa-03f12004517d tempest-VolumesImageMetadata-217992612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.646s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:37 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-55373c14-0a2d-4bc1-b0aa-03f12004517d tempest-VolumesImageMetadata-217992612 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:16:37 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-55373c14-0a2d-4bc1-b0aa-03f12004517d tempest-VolumesImageMetadata-217992612 None] Deleted volume successfully. Nov 03 13:16:37 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-55373c14-0a2d-4bc1-b0aa-03f12004517d tempest-VolumesImageMetadata-217992612 None] Lock "cinder-52fe2414-fdf6-4522-a7fe-33776c0423c9-delete_volume" released by "delete_volume" :: held 2.299s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:16:37 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c1eae2db-465a-44b5-bfaf-762b4c850d23 tempest-VolumesTestJSON-499702340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9c7efa9d-bd3a-4f8f-b9c4-6a9bc8666869" returned: 0 in 0.659s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c1eae2db-465a-44b5-bfaf-762b4c850d23 tempest-VolumesTestJSON-499702340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9c7efa9d-bd3a-4f8f-b9c4-6a9bc8666869 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:37 devstack sudo[98425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9c7efa9d-bd3a-4f8f-b9c4-6a9bc8666869 Nov 03 13:16:37 devstack sudo[98425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:38 devstack sudo[98425]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c1eae2db-465a-44b5-bfaf-762b4c850d23 tempest-VolumesTestJSON-499702340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9c7efa9d-bd3a-4f8f-b9c4-6a9bc8666869" returned: 0 in 0.549s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:38 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c1eae2db-465a-44b5-bfaf-762b4c850d23 tempest-VolumesTestJSON-499702340 None] Lock "cinder-quobyte-9c7efa9d-bd3a-4f8f-b9c4-6a9bc8666869" released by "delete_volume" :: held 1.299s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:16:38 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-c1eae2db-465a-44b5-bfaf-762b4c850d23 tempest-VolumesTestJSON-499702340 None] Created reservations ['4a8ac58e-a2fc-44da-9a00-a6be9ca4a60b', '342fbc90-9c5b-40d8-987b-17b88b2884b0', 'b11ad338-e63e-4736-bd5c-8320b5be72a4', '070d5780-4bdd-4eb2-91c4-3a0ba306e994'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:16:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c1eae2db-465a-44b5-bfaf-762b4c850d23 tempest-VolumesTestJSON-499702340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:16:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c1eae2db-465a-44b5-bfaf-762b4c850d23 tempest-VolumesTestJSON-499702340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:16:38 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-c1eae2db-465a-44b5-bfaf-762b4c850d23 tempest-VolumesTestJSON-499702340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:16:38 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-c1eae2db-465a-44b5-bfaf-762b4c850d23 tempest-VolumesTestJSON-499702340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:16:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c1eae2db-465a-44b5-bfaf-762b4c850d23 tempest-VolumesTestJSON-499702340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:16:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c1eae2db-465a-44b5-bfaf-762b4c850d23 tempest-VolumesTestJSON-499702340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:38 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:16:38 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:38 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c1eae2db-465a-44b5-bfaf-762b4c850d23 tempest-VolumesTestJSON-499702340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.344s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:38 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-c1eae2db-465a-44b5-bfaf-762b4c850d23 tempest-VolumesTestJSON-499702340 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:16:38 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-c1eae2db-465a-44b5-bfaf-762b4c850d23 tempest-VolumesTestJSON-499702340 None] Deleted volume successfully. Nov 03 13:16:38 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c1eae2db-465a-44b5-bfaf-762b4c850d23 tempest-VolumesTestJSON-499702340 None] Lock "cinder-9c7efa9d-bd3a-4f8f-b9c4-6a9bc8666869-delete_volume" released by "delete_volume" :: held 2.031s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:16:48 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:UPDATE=84,cinder:SELECT=61,cinder:INSERT=23,cinder:DELETE=6 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:16:48 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=58,cinder:INSERT=28,cinder:UPDATE=83,cinder:DELETE=8 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:16:51 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:16:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] Flow 'volume_create_manager' (29cb2264-8417-4cec-baf0-1564f42bd5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:16:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c9dec7-aab2-4f66-9e93-06b334908612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c9dec7-aab2-4f66-9e93-06b334908612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1892450108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a421ca3-1c47-4a80-a3a1-60a30b2bd555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28d89111a94442bbbffbd1b9b260a715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:16:51Z,use_quota=True,user_id='da45eacc2e8344d59bac6618dced948a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (648e6583-a1e2-4618-be8e-f4778d90a1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (648e6583-a1e2-4618-be8e-f4778d90a1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be2dec32-62a0-4739-a881-296f387cf29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be2dec32-62a0-4739-a881-296f387cf29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a421ca3-1c47-4a80-a3a1-60a30b2bd555', 'volume_name': 'volume-1a421ca3-1c47-4a80-a3a1-60a30b2bd555', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1a8b190-124a-49c6-ac64-97d40bcd86c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1a8b190-124a-49c6-ac64-97d40bcd86c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (778f538d-d792-42ea-8da7-e1df60f96a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:51 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] Volume 1a421ca3-1c47-4a80-a3a1-60a30b2bd555: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a421ca3-1c47-4a80-a3a1-60a30b2bd555', 'volume_size': 1} Nov 03 13:16:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:16:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:16:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1892450108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a421ca3-1c47-4a80-a3a1-60a30b2bd555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28d89111a94442bbbffbd1b9b260a715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:16:51Z,use_quota=True,user_id='da45eacc2e8344d59bac6618dced948a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:16:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] Creating volume 1a421ca3-1c47-4a80-a3a1-60a30b2bd555 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:16:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:16:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:16:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:16:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:16:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:16:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:16:51 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:16:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1a421ca3-1c47-4a80-a3a1-60a30b2bd555 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:51 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1a421ca3-1c47-4a80-a3a1-60a30b2bd555 1073741824 Nov 03 13:16:51 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:51 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1a421ca3-1c47-4a80-a3a1-60a30b2bd555 1073741824" returned: 0 in 0.501s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1a421ca3-1c47-4a80-a3a1-60a30b2bd555 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:51 devstack sudo[98509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1a421ca3-1c47-4a80-a3a1-60a30b2bd555 Nov 03 13:16:51 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:51 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1a421ca3-1c47-4a80-a3a1-60a30b2bd555" returned: 0 in 0.273s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:16:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:16:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (778f538d-d792-42ea-8da7-e1df60f96a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a421ca3-1c47-4a80-a3a1-60a30b2bd555', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (558bb177-638c-4ed4-b181-c18eb0faf3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:52 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] Volume volume-1a421ca3-1c47-4a80-a3a1-60a30b2bd555 (1a421ca3-1c47-4a80-a3a1-60a30b2bd555): created successfully Nov 03 13:16:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (558bb177-638c-4ed4-b181-c18eb0faf3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] Flow 'volume_create_manager' (29cb2264-8417-4cec-baf0-1564f42bd5ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:16:52 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-380c5550-e66a-45b5-bdcd-074cc1ada4bb tempest-AbsoluteLimitsTests-1939692652 None] Created volume successfully. Nov 03 13:16:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-7af8a4e4-fc01-48a8-87d8-646db37d809a tempest-AbsoluteLimitsTests-1939692652 None] Acquiring lock "cinder-1a421ca3-1c47-4a80-a3a1-60a30b2bd555-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:16:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-7af8a4e4-fc01-48a8-87d8-646db37d809a tempest-AbsoluteLimitsTests-1939692652 None] Lock "cinder-1a421ca3-1c47-4a80-a3a1-60a30b2bd555-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:16:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-7af8a4e4-fc01-48a8-87d8-646db37d809a tempest-AbsoluteLimitsTests-1939692652 None] Acquiring lock "cinder-quobyte-1a421ca3-1c47-4a80-a3a1-60a30b2bd555" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:16:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-7af8a4e4-fc01-48a8-87d8-646db37d809a tempest-AbsoluteLimitsTests-1939692652 None] Lock "cinder-quobyte-1a421ca3-1c47-4a80-a3a1-60a30b2bd555" acquired by "delete_volume" :: waited 0.045s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:16:54 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef4f80b-88df-445f-b928-bab2a55575d2]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:16:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7af8a4e4-fc01-48a8-87d8-646db37d809a tempest-AbsoluteLimitsTests-1939692652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1a421ca3-1c47-4a80-a3a1-60a30b2bd555 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:54 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1a421ca3-1c47-4a80-a3a1-60a30b2bd555 Nov 03 13:16:54 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:54 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7af8a4e4-fc01-48a8-87d8-646db37d809a tempest-AbsoluteLimitsTests-1939692652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1a421ca3-1c47-4a80-a3a1-60a30b2bd555" returned: 0 in 0.673s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7af8a4e4-fc01-48a8-87d8-646db37d809a tempest-AbsoluteLimitsTests-1939692652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1a421ca3-1c47-4a80-a3a1-60a30b2bd555 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:54 devstack sudo[98521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1a421ca3-1c47-4a80-a3a1-60a30b2bd555 Nov 03 13:16:54 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:55 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-fd2d5c1d-02fc-4aa3-9c15-b3e489dbeada tempest-GroupsV314Test-79443452 None] Group tempest-GroupsV314Test-Group-1477448997: creating Nov 03 13:16:55 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-fd2d5c1d-02fc-4aa3-9c15-b3e489dbeada tempest-GroupsV314Test-79443452 None] Group tempest-GroupsV314Test-Group-1477448997: created successfully Nov 03 13:16:55 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-fd2d5c1d-02fc-4aa3-9c15-b3e489dbeada tempest-GroupsV314Test-79443452 None] Create group completed successfully. Nov 03 13:16:55 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7af8a4e4-fc01-48a8-87d8-646db37d809a tempest-AbsoluteLimitsTests-1939692652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1a421ca3-1c47-4a80-a3a1-60a30b2bd555" returned: 0 in 0.595s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:55 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-7af8a4e4-fc01-48a8-87d8-646db37d809a tempest-AbsoluteLimitsTests-1939692652 None] Lock "cinder-quobyte-1a421ca3-1c47-4a80-a3a1-60a30b2bd555" released by "delete_volume" :: held 1.362s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:16:55 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-7af8a4e4-fc01-48a8-87d8-646db37d809a tempest-AbsoluteLimitsTests-1939692652 None] Created reservations ['ae1891c7-06ed-4950-8177-51ca5f7805dc', 'a5abacdf-90c9-4c34-93c8-3d87d445e98b', 'c435c216-2cb8-44f7-a3bd-11a9f0760f42', '1097904c-cf05-4f43-8f4f-ed81186057b1'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:16:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7af8a4e4-fc01-48a8-87d8-646db37d809a tempest-AbsoluteLimitsTests-1939692652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:16:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7af8a4e4-fc01-48a8-87d8-646db37d809a tempest-AbsoluteLimitsTests-1939692652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:16:55 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7af8a4e4-fc01-48a8-87d8-646db37d809a tempest-AbsoluteLimitsTests-1939692652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:16:55 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7af8a4e4-fc01-48a8-87d8-646db37d809a tempest-AbsoluteLimitsTests-1939692652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:16:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7af8a4e4-fc01-48a8-87d8-646db37d809a tempest-AbsoluteLimitsTests-1939692652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:16:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7af8a4e4-fc01-48a8-87d8-646db37d809a tempest-AbsoluteLimitsTests-1939692652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:55 devstack sudo[98542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:16:55 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:55 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7af8a4e4-fc01-48a8-87d8-646db37d809a tempest-AbsoluteLimitsTests-1939692652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.383s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:55 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-7af8a4e4-fc01-48a8-87d8-646db37d809a tempest-AbsoluteLimitsTests-1939692652 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:16:55 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-7af8a4e4-fc01-48a8-87d8-646db37d809a tempest-AbsoluteLimitsTests-1939692652 None] Deleted volume successfully. Nov 03 13:16:55 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-7af8a4e4-fc01-48a8-87d8-646db37d809a tempest-AbsoluteLimitsTests-1939692652 None] Lock "cinder-1a421ca3-1c47-4a80-a3a1-60a30b2bd555-delete_volume" released by "delete_volume" :: held 2.151s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:16:57 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:16:57 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] Flow 'volume_create_manager' (9c8a792f-e4d1-48a7-b297-6094106cdf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:16:57 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f7616f4-728f-4373-bf8a-c1277a58f7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:57 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f7616f4-728f-4373-bf8a-c1277a58f7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1772732088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f05e1025-3dc0-4366-b67e-4016c541e2f0,host='devstack@QuobyteHD#QuobyteHD',id=df87a5a8-9d0e-496d-858a-4f38a567154b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb898c5df8b47a980b3793362f853e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:16:57Z,use_quota=True,user_id='0a927fb8a9d5471598018922e34ff9dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cab835fe-c213-4887-bf98-401aba5f4e01),volume_type_id=cab835fe-c213-4887-bf98-401aba5f4e01)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:57 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21eae29e-40b7-4cb9-a7cc-f34dce66986e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:57 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21eae29e-40b7-4cb9-a7cc-f34dce66986e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:57 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a5f321-cbcb-43a7-845e-d9fd6b00c0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:57 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a5f321-cbcb-43a7-845e-d9fd6b00c0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df87a5a8-9d0e-496d-858a-4f38a567154b', 'volume_name': 'volume-df87a5a8-9d0e-496d-858a-4f38a567154b', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:57 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea458680-e43f-4c3e-a685-b2693cb14516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:57 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea458680-e43f-4c3e-a685-b2693cb14516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:57 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70a5ae3e-c336-44f9-ae3f-5166a80543a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:57 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] Volume df87a5a8-9d0e-496d-858a-4f38a567154b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df87a5a8-9d0e-496d-858a-4f38a567154b', 'volume_size': 1} Nov 03 13:16:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:16:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:16:57 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f05e1025-3dc0-4366-b67e-4016c541e2f0,created_at=2026-11-03T12:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1772732088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f05e1025-3dc0-4366-b67e-4016c541e2f0,host='devstack@QuobyteHD#QuobyteHD',id=df87a5a8-9d0e-496d-858a-4f38a567154b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb898c5df8b47a980b3793362f853e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:16:57Z,use_quota=True,user_id='0a927fb8a9d5471598018922e34ff9dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cab835fe-c213-4887-bf98-401aba5f4e01),volume_type_id=cab835fe-c213-4887-bf98-401aba5f4e01)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:16:57 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] Creating volume df87a5a8-9d0e-496d-858a-4f38a567154b {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:16:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:16:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:16:57 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:16:57 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:16:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:16:57 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:16:57 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:16:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:57 devstack sudo[98585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b 1073741824 Nov 03 13:16:57 devstack sudo[98585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:58 devstack sudo[98585]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b 1073741824" returned: 0 in 1.052s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:58 devstack sudo[98639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b Nov 03 13:16:58 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:58 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:16:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:16:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:16:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:16:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:16:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:16:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:58 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:16:58 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:59 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b" returned: 0 in 0.477s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:59 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:16:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:16:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70a5ae3e-c336-44f9-ae3f-5166a80543a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df87a5a8-9d0e-496d-858a-4f38a567154b', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8603aeca-ccb8-494f-b3db-82de28963bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:59 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] Volume volume-df87a5a8-9d0e-496d-858a-4f38a567154b (df87a5a8-9d0e-496d-858a-4f38a567154b): created successfully Nov 03 13:16:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8603aeca-ccb8-494f-b3db-82de28963bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] Flow 'volume_create_manager' (9c8a792f-e4d1-48a7-b297-6094106cdf31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:16:59 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-5bb6cf11-3e22-4423-87c7-f147ab4c1a4d tempest-GroupsV314Test-79443452 None] Created volume successfully. Nov 03 13:16:59 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.613s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:59 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:16:59 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager._thread_info {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:16:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread count: 28 {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:16:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread info: [<_MainThread(MainThread, started 133507074375808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:17:00 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:17:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Flow 'volume_create_manager' (03cc5184-c6e6-4451-a176-9a89272d4403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:17:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c55f0189-b732-4b7d-a70c-175d668076ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c55f0189-b732-4b7d-a70c-175d668076ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1221095864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa65b7fe-97a9-4a02-9836-7dbf2becd3b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa204bbe8e0e46f683ac203a60c554a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:17:00Z,use_quota=True,user_id='81b20c7790ee4606bab7b980e9a7715d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18866d7e-a9ec-4a66-b73d-2d3e0ac5058a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18866d7e-a9ec-4a66-b73d-2d3e0ac5058a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb90ca10-15ed-4da6-8562-4279739a3f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb90ca10-15ed-4da6-8562-4279739a3f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa65b7fe-97a9-4a02-9836-7dbf2becd3b1', 'volume_name': 'volume-fa65b7fe-97a9-4a02-9836-7dbf2becd3b1', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da0d8932-1341-4244-8894-2e5c5f46a85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da0d8932-1341-4244-8894-2e5c5f46a85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d29289-fb98-45ed-8015-1417519d65be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:00 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Volume fa65b7fe-97a9-4a02-9836-7dbf2becd3b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa65b7fe-97a9-4a02-9836-7dbf2becd3b1', 'volume_size': 1} Nov 03 13:17:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:00 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1221095864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa65b7fe-97a9-4a02-9836-7dbf2becd3b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa204bbe8e0e46f683ac203a60c554a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:17:00Z,use_quota=True,user_id='81b20c7790ee4606bab7b980e9a7715d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:17:00 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Creating volume fa65b7fe-97a9-4a02-9836-7dbf2becd3b1 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:17:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:00 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:17:00 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:17:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:00 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:17:00 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:17:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-fa65b7fe-97a9-4a02-9836-7dbf2becd3b1 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:00 devstack sudo[98649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-fa65b7fe-97a9-4a02-9836-7dbf2becd3b1 1073741824 Nov 03 13:17:00 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:01 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-fa65b7fe-97a9-4a02-9836-7dbf2becd3b1 1073741824" returned: 0 in 0.920s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-fa65b7fe-97a9-4a02-9836-7dbf2becd3b1 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:01 devstack sudo[98658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-fa65b7fe-97a9-4a02-9836-7dbf2becd3b1 Nov 03 13:17:01 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:01 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-fa65b7fe-97a9-4a02-9836-7dbf2becd3b1" returned: 0 in 0.341s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:01 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:17:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.659s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:01 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Cloning volume df87a5a8-9d0e-496d-858a-4f38a567154b to volume c293fd7d-c2f0-4214-b62d-f0a58961a950 Nov 03 13:17:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d29289-fb98-45ed-8015-1417519d65be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa65b7fe-97a9-4a02-9836-7dbf2becd3b1', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (626045fe-7f40-43fd-bd8c-3bc197b179b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:01 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Creating offline snapshot 7093f1bc-d5a0-442e-b1b2-b0aaa5b9e502 of volume df87a5a8-9d0e-496d-858a-4f38a567154b {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:17:01 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Volume volume-fa65b7fe-97a9-4a02-9836-7dbf2becd3b1 (fa65b7fe-97a9-4a02-9836-7dbf2becd3b1): created successfully Nov 03 13:17:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (626045fe-7f40-43fd-bd8c-3bc197b179b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Flow 'volume_create_manager' (03cc5184-c6e6-4451-a176-9a89272d4403) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:17:01 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[081842cb-ea09-42ba-9af0-114a0dbbe443]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:17:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:02 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-a4176ee4-57fb-4f06-9cdc-ace930d8f14d tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Created volume successfully. Nov 03 13:17:02 devstack sudo[98661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b Nov 03 13:17:02 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:02 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b" returned: 0 in 0.649s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b.7093f1bc-d5a0-442e-b1b2-b0aaa5b9e502 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:02 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b.7093f1bc-d5a0-442e-b1b2-b0aaa5b9e502 1G Nov 03 13:17:02 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:02 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:17:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] Flow 'volume_create_manager' (2f6c7ac1-a814-4d2b-9670-b1082e0f7986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:17:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6775c8df-c832-45b7-be37-940f09089e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6775c8df-c832-45b7-be37-940f09089e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-498419620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b565cfb0-1c2c-445c-8ea2-a5030a89141f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84ccf52b8d7d46b5b0f2aa579d99900c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:17:03Z,use_quota=True,user_id='c6dff2ea2eeb4cfe8b5651cfe228dfd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a55f322a-37d8-4638-be20-b3c5b81f4a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a55f322a-37d8-4638-be20-b3c5b81f4a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3016311-1214-454d-bd7b-d440d4c452a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3016311-1214-454d-bd7b-d440d4c452a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b565cfb0-1c2c-445c-8ea2-a5030a89141f', 'volume_name': 'volume-b565cfb0-1c2c-445c-8ea2-a5030a89141f', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04939b1e-03d7-4472-9e42-b24d58e5a710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04939b1e-03d7-4472-9e42-b24d58e5a710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ab066c-ffec-4276-9b77-92f202f29208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:02 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] Volume b565cfb0-1c2c-445c-8ea2-a5030a89141f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b565cfb0-1c2c-445c-8ea2-a5030a89141f', 'volume_size': 1} Nov 03 13:17:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:03 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b.7093f1bc-d5a0-442e-b1b2-b0aaa5b9e502 1G" returned: 0 in 0.534s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df87a5a8-9d0e-496d-858a-4f38a567154b -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b.7093f1bc-d5a0-442e-b1b2-b0aaa5b9e502 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:03 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df87a5a8-9d0e-496d-858a-4f38a567154b -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b.7093f1bc-d5a0-442e-b1b2-b0aaa5b9e502 Nov 03 13:17:03 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:03 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df87a5a8-9d0e-496d-858a-4f38a567154b -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b.7093f1bc-d5a0-442e-b1b2-b0aaa5b9e502" returned: 0 in 0.515s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:03 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b.7093f1bc-d5a0-442e-b1b2-b0aaa5b9e502 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 13:17:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b.7093f1bc-d5a0-442e-b1b2-b0aaa5b9e502 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:03 devstack sudo[98680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b.7093f1bc-d5a0-442e-b1b2-b0aaa5b9e502 Nov 03 13:17:03 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:04 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b.7093f1bc-d5a0-442e-b1b2-b0aaa5b9e502" returned: 0 in 0.360s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:04 devstack sudo[98692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b.info Nov 03 13:17:04 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-375b4ac3-0266-4a54-b88c-f047af942c09 req-7270f63a-9c45-4945-8549-fa37a68fd956 tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:04 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b.info" returned: 0 in 0.306s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:04 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 13:17:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:04 devstack sudo[98695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b.info Nov 03 13:17:04 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:04 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b.info" returned: 0 in 0.259s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:04 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Acquiring lock "cinder-quobyte-c293fd7d-c2f0-4214-b62d-f0a58961a950" by "_copy_volume_from_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:17:04 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Lock "cinder-quobyte-c293fd7d-c2f0-4214-b62d-f0a58961a950" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:17:04 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] snapshot: 7093f1bc-d5a0-442e-b1b2-b0aaa5b9e502, volume: c293fd7d-c2f0-4214-b62d-f0a58961a950, {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 13:17:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:04 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:17:04 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:17:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:04 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d29574-32be-49df-9d5a-8ae7936860dc]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:17:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b.7093f1bc-d5a0-442e-b1b2-b0aaa5b9e502 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:04 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b.7093f1bc-d5a0-442e-b1b2-b0aaa5b9e502 Nov 03 13:17:04 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:05 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b.7093f1bc-d5a0-442e-b1b2-b0aaa5b9e502" returned: 0 in 0.410s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:05 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df87a5a8-9d0e-496d-858a-4f38a567154b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:17:05 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[0557ac4d-dade-41c2-85da-302a8b376270]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:17:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:05 devstack sudo[98703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b Nov 03 13:17:05 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:05 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b" returned: 0 in 0.444s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:05 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 13:17:05 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Creating direct copy from snapshot {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 13:17:05 devstack cinder-volume[86725]: DEBUG cinder.utils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Path /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c293fd7d-c2f0-4214-b62d-f0a58961a950 not found in is_blk_device check {{(pid=86725) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 13:17:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c293fd7d-c2f0-4214-b62d-f0a58961a950 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:05 devstack sudo[98708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c293fd7d-c2f0-4214-b62d-f0a58961a950 Nov 03 13:17:05 devstack sudo[98708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:07 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:17:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] Flow 'volume_create_manager' (9926c58e-ce35-47cd-ac53-29ca2b26e015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:17:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a220b8ca-2d55-4cfa-b0db-9402ef76bc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a220b8ca-2d55-4cfa-b0db-9402ef76bc45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1128406651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d53272-3f82-4e53-9540-f52578934672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35fa48e2d984f5a9778fc249fde1b00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:17:07Z,use_quota=True,user_id='cba7e56048f4417fa7e86e37da578d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50291bcd-9c3f-498f-ac47-687e6cf95dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50291bcd-9c3f-498f-ac47-687e6cf95dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b05bf198-b525-4316-8157-b14a944cdd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b05bf198-b525-4316-8157-b14a944cdd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50d53272-3f82-4e53-9540-f52578934672', 'volume_name': 'volume-50d53272-3f82-4e53-9540-f52578934672', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2235911a-a6ec-4a51-9e62-16d57d2f4f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2235911a-a6ec-4a51-9e62-16d57d2f4f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5897efe-8676-497f-a76d-8ae3939a4124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:07 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] Volume 50d53272-3f82-4e53-9540-f52578934672: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50d53272-3f82-4e53-9540-f52578934672', 'volume_size': 1} Nov 03 13:17:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:13 devstack sudo[98708]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c293fd7d-c2f0-4214-b62d-f0a58961a950" returned: 0 in 7.879s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:13 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b, size 1024.00 MB, duration 7.88 sec, destination /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c293fd7d-c2f0-4214-b62d-f0a58961a950 {{(pid=86725) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:17:13 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Converted 1024.00 MB image at 129.96 MB/s Nov 03 13:17:13 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c293fd7d-c2f0-4214-b62d-f0a58961a950 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 13:17:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c293fd7d-c2f0-4214-b62d-f0a58961a950 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:13 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c293fd7d-c2f0-4214-b62d-f0a58961a950 Nov 03 13:17:13 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:13 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c293fd7d-c2f0-4214-b62d-f0a58961a950" returned: 0 in 0.241s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:13 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Lock "cinder-quobyte-c293fd7d-c2f0-4214-b62d-f0a58961a950" released by "_copy_volume_from_snapshot" :: held 9.064s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:17:13 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Acquiring lock "cinder-quobyte-7093f1bc-d5a0-442e-b1b2-b0aaa5b9e502" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:17:13 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Lock "cinder-quobyte-7093f1bc-d5a0-442e-b1b2-b0aaa5b9e502" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:17:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Deleting offline snapshot 7093f1bc-d5a0-442e-b1b2-b0aaa5b9e502 of volume df87a5a8-9d0e-496d-858a-4f38a567154b {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:17:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] snapshot_file for this snap is: volume-df87a5a8-9d0e-496d-858a-4f38a567154b.7093f1bc-d5a0-442e-b1b2-b0aaa5b9e502 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:17:13 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[25415005-6c72-4280-82a5-2e3d4951dcb5]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:17:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b.7093f1bc-d5a0-442e-b1b2-b0aaa5b9e502 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:13 devstack sudo[98741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b.7093f1bc-d5a0-442e-b1b2-b0aaa5b9e502 Nov 03 13:17:13 devstack sudo[98741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:14 devstack sudo[98741]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b.7093f1bc-d5a0-442e-b1b2-b0aaa5b9e502" returned: 0 in 0.351s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:14 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df87a5a8-9d0e-496d-858a-4f38a567154b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:17:14 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[99dd48b2-a011-43d4-97b7-eac61e5f684b]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:17:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:14 devstack sudo[98746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b Nov 03 13:17:14 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:14 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b" returned: 0 in 0.507s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b.7093f1bc-d5a0-442e-b1b2-b0aaa5b9e502 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:14 devstack sudo[98751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b.7093f1bc-d5a0-442e-b1b2-b0aaa5b9e502 Nov 03 13:17:14 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:15 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b.7093f1bc-d5a0-442e-b1b2-b0aaa5b9e502" returned: 0 in 0.326s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b.7093f1bc-d5a0-442e-b1b2-b0aaa5b9e502 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:15 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b.7093f1bc-d5a0-442e-b1b2-b0aaa5b9e502 Nov 03 13:17:15 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:15 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b.7093f1bc-d5a0-442e-b1b2-b0aaa5b9e502" returned: 0 in 0.242s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:15 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Lock "cinder-quobyte-7093f1bc-d5a0-442e-b1b2-b0aaa5b9e502" released by "_delete_snapshot" :: held 1.517s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:17:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.497s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.422s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:15 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-498419620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b565cfb0-1c2c-445c-8ea2-a5030a89141f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84ccf52b8d7d46b5b0f2aa579d99900c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:17:03Z,use_quota=True,user_id='c6dff2ea2eeb4cfe8b5651cfe228dfd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:17:15 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] Creating volume b565cfb0-1c2c-445c-8ea2-a5030a89141f {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:17:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:15 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:17:15 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:17:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:15 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:17:15 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:17:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b565cfb0-1c2c-445c-8ea2-a5030a89141f 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:15 devstack sudo[98759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b565cfb0-1c2c-445c-8ea2-a5030a89141f 1073741824 Nov 03 13:17:15 devstack sudo[98759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:15 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-04fec7e0-bafe-43b7-8a6e-16d21edef7ce tempest-GroupsV314Test-79443452 None] Create group from source-group-f05e1025-3dc0-4366-b67e-4016c541e2f0 completed successfully. Nov 03 13:17:15 devstack sudo[98759]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b565cfb0-1c2c-445c-8ea2-a5030a89141f 1073741824" returned: 0 in 0.485s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b565cfb0-1c2c-445c-8ea2-a5030a89141f {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:15 devstack sudo[98765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b565cfb0-1c2c-445c-8ea2-a5030a89141f Nov 03 13:17:15 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:16 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-11ee9a36-f44f-4eb3-9fc8-1c3f4dfbaeaf tempest-GroupsV314Test-79443452 None] Acquiring lock "cinder-quobyte-c293fd7d-c2f0-4214-b62d-f0a58961a950" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:17:16 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-11ee9a36-f44f-4eb3-9fc8-1c3f4dfbaeaf tempest-GroupsV314Test-79443452 None] Lock "cinder-quobyte-c293fd7d-c2f0-4214-b62d-f0a58961a950" acquired by "delete_volume" :: waited 0.017s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:17:16 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b565cfb0-1c2c-445c-8ea2-a5030a89141f" returned: 0 in 0.267s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:16 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:17:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-375b4ac3-0266-4a54-b88c-f047af942c09 req-7270f63a-9c45-4945-8549-fa37a68fd956 tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.907s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:16 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fec689-b058-46ad-a773-0a23b76daca6]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:17:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-11ee9a36-f44f-4eb3-9fc8-1c3f4dfbaeaf tempest-GroupsV314Test-79443452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c293fd7d-c2f0-4214-b62d-f0a58961a950 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:16 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ab066c-ffec-4276-9b77-92f202f29208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b565cfb0-1c2c-445c-8ea2-a5030a89141f', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:16 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347ccaa0-b07d-421d-9c97-aba1f80ddc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-375b4ac3-0266-4a54-b88c-f047af942c09 req-7270f63a-9c45-4945-8549-fa37a68fd956 tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.693s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:16 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1128406651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d53272-3f82-4e53-9540-f52578934672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35fa48e2d984f5a9778fc249fde1b00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:17:07Z,use_quota=True,user_id='cba7e56048f4417fa7e86e37da578d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:17:16 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] Creating volume 50d53272-3f82-4e53-9540-f52578934672 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:17:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:16 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:17:16 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:17:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:16 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:17:16 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:17:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-50d53272-3f82-4e53-9540-f52578934672 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:16 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] Volume volume-b565cfb0-1c2c-445c-8ea2-a5030a89141f (b565cfb0-1c2c-445c-8ea2-a5030a89141f): created successfully Nov 03 13:17:16 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347ccaa0-b07d-421d-9c97-aba1f80ddc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:16 devstack sudo[98769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-50d53272-3f82-4e53-9540-f52578934672 1073741824 Nov 03 13:17:16 devstack sudo[98769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:16 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] Flow 'volume_create_manager' (2f6c7ac1-a814-4d2b-9670-b1082e0f7986) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:17:16 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-ab89c0e8-cad3-4499-a0ee-076961c2effe tempest-TestMinimumBasicScenario-347707430 None] Created volume successfully. Nov 03 13:17:16 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-375b4ac3-0266-4a54-b88c-f047af942c09 req-7270f63a-9c45-4945-8549-fa37a68fd956 tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43', 'name': 'volume-fa65b7fe-97a9-4a02-9836-7dbf2becd3b1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a10acff-6a7b-40dc-8ff0-f8a93d164621', 'enforce_multipath': True} {{(pid=86725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:17:16 devstack sudo[98768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c293fd7d-c2f0-4214-b62d-f0a58961a950 Nov 03 13:17:16 devstack sudo[98768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:16 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-375b4ac3-0266-4a54-b88c-f047af942c09 req-7270f63a-9c45-4945-8549-fa37a68fd956 tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] attachment_update completed successfully. Nov 03 13:17:16 devstack sudo[98768]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-11ee9a36-f44f-4eb3-9fc8-1c3f4dfbaeaf tempest-GroupsV314Test-79443452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c293fd7d-c2f0-4214-b62d-f0a58961a950" returned: 0 in 0.411s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-11ee9a36-f44f-4eb3-9fc8-1c3f4dfbaeaf tempest-GroupsV314Test-79443452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c293fd7d-c2f0-4214-b62d-f0a58961a950 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:16 devstack sudo[98858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c293fd7d-c2f0-4214-b62d-f0a58961a950 Nov 03 13:17:16 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:16 devstack sudo[98769]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-50d53272-3f82-4e53-9540-f52578934672 1073741824" returned: 0 in 0.550s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-50d53272-3f82-4e53-9540-f52578934672 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:16 devstack sudo[99197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-50d53272-3f82-4e53-9540-f52578934672 Nov 03 13:17:16 devstack sudo[99197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:16 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-11ee9a36-f44f-4eb3-9fc8-1c3f4dfbaeaf tempest-GroupsV314Test-79443452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c293fd7d-c2f0-4214-b62d-f0a58961a950" returned: 0 in 0.369s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:16 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-11ee9a36-f44f-4eb3-9fc8-1c3f4dfbaeaf tempest-GroupsV314Test-79443452 None] Lock "cinder-quobyte-c293fd7d-c2f0-4214-b62d-f0a58961a950" released by "delete_volume" :: held 0.838s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:17:17 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-11ee9a36-f44f-4eb3-9fc8-1c3f4dfbaeaf tempest-GroupsV314Test-79443452 None] Created reservations ['a7ff92de-cc71-4fed-97f8-290b811364b4'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:17:17 devstack cinder-volume[86725]: WARNING cinder.quota [None req-11ee9a36-f44f-4eb3-9fc8-1c3f4dfbaeaf tempest-GroupsV314Test-79443452 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-147608958 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-147608958, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:17:17 devstack cinder-volume[86725]: WARNING cinder.quota [None req-11ee9a36-f44f-4eb3-9fc8-1c3f4dfbaeaf tempest-GroupsV314Test-79443452 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-147608958 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-147608958, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:17:17 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-11ee9a36-f44f-4eb3-9fc8-1c3f4dfbaeaf tempest-GroupsV314Test-79443452 None] Created reservations ['f2b20e9b-7dda-4732-a31c-05776ed24b76', 'f3277538-3630-4b92-8b65-2eeff873a353', '93e7c7aa-d950-4fdd-a682-4041fa44f556', 'e09287e0-84d0-4d37-bfd8-ceec2fef7716'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:17:17 devstack sudo[99197]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-50d53272-3f82-4e53-9540-f52578934672" returned: 0 in 0.332s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:17 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:17:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:17 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5897efe-8676-497f-a76d-8ae3939a4124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50d53272-3f82-4e53-9540-f52578934672', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:17 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e625f839-1efe-448a-8e87-8e23095b34bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:17 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] Volume volume-50d53272-3f82-4e53-9540-f52578934672 (50d53272-3f82-4e53-9540-f52578934672): created successfully Nov 03 13:17:17 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e625f839-1efe-448a-8e87-8e23095b34bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:17 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] Flow 'volume_create_manager' (9926c58e-ce35-47cd-ac53-29ca2b26e015) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:17:17 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-aa37a772-78a2-4c12-9b74-43cbb605f49d tempest-VolumesTransfersV355Test-1210689020 None] Created volume successfully. Nov 03 13:17:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-11ee9a36-f44f-4eb3-9fc8-1c3f4dfbaeaf tempest-GroupsV314Test-79443452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-11ee9a36-f44f-4eb3-9fc8-1c3f4dfbaeaf tempest-GroupsV314Test-79443452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:17 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-11ee9a36-f44f-4eb3-9fc8-1c3f4dfbaeaf tempest-GroupsV314Test-79443452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:17:17 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-11ee9a36-f44f-4eb3-9fc8-1c3f4dfbaeaf tempest-GroupsV314Test-79443452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:17:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-11ee9a36-f44f-4eb3-9fc8-1c3f4dfbaeaf tempest-GroupsV314Test-79443452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-11ee9a36-f44f-4eb3-9fc8-1c3f4dfbaeaf tempest-GroupsV314Test-79443452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:17 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:17:17 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:17 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-11ee9a36-f44f-4eb3-9fc8-1c3f4dfbaeaf tempest-GroupsV314Test-79443452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.313s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:17 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-11ee9a36-f44f-4eb3-9fc8-1c3f4dfbaeaf tempest-GroupsV314Test-79443452 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:17:17 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-11ee9a36-f44f-4eb3-9fc8-1c3f4dfbaeaf tempest-GroupsV314Test-79443452 None] Delete group completed successfully. Nov 03 13:17:17 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-078d6ba1-40e4-4f15-9e41-eaa484811017 tempest-GroupsV314Test-79443452 None] Acquiring lock "cinder-quobyte-df87a5a8-9d0e-496d-858a-4f38a567154b" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:17:17 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-078d6ba1-40e4-4f15-9e41-eaa484811017 tempest-GroupsV314Test-79443452 None] Lock "cinder-quobyte-df87a5a8-9d0e-496d-858a-4f38a567154b" acquired by "delete_volume" :: waited 0.017s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:17:17 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a81e6d-773a-4506-a71c-e31420391c74]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:17:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-078d6ba1-40e4-4f15-9e41-eaa484811017 tempest-GroupsV314Test-79443452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:17 devstack sudo[99207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b Nov 03 13:17:17 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:18 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-078d6ba1-40e4-4f15-9e41-eaa484811017 tempest-GroupsV314Test-79443452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b" returned: 0 in 0.498s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-078d6ba1-40e4-4f15-9e41-eaa484811017 tempest-GroupsV314Test-79443452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:18 devstack sudo[99221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b Nov 03 13:17:18 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-acb3594e-6869-4d29-b139-30f88cfecc62 req-0bf0e879-9869-4516-82bf-bc711b6b40e6 tempest-TestMinimumBasicScenario-347707430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-acb3594e-6869-4d29-b139-30f88cfecc62 req-0bf0e879-9869-4516-82bf-bc711b6b40e6 tempest-TestMinimumBasicScenario-347707430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-acb3594e-6869-4d29-b139-30f88cfecc62 req-0bf0e879-9869-4516-82bf-bc711b6b40e6 tempest-TestMinimumBasicScenario-347707430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:18 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-acb3594e-6869-4d29-b139-30f88cfecc62 req-0bf0e879-9869-4516-82bf-bc711b6b40e6 tempest-TestMinimumBasicScenario-347707430 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43', 'name': 'volume-b565cfb0-1c2c-445c-8ea2-a5030a89141f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf9d25e3-dc00-48ec-bdf4-2209de00da53', 'enforce_multipath': True} {{(pid=86725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:17:18 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-acb3594e-6869-4d29-b139-30f88cfecc62 req-0bf0e879-9869-4516-82bf-bc711b6b40e6 tempest-TestMinimumBasicScenario-347707430 None] attachment_update completed successfully. Nov 03 13:17:18 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-078d6ba1-40e4-4f15-9e41-eaa484811017 tempest-GroupsV314Test-79443452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-df87a5a8-9d0e-496d-858a-4f38a567154b" returned: 0 in 0.335s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:18 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-078d6ba1-40e4-4f15-9e41-eaa484811017 tempest-GroupsV314Test-79443452 None] Lock "cinder-quobyte-df87a5a8-9d0e-496d-858a-4f38a567154b" released by "delete_volume" :: held 0.911s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:17:18 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-078d6ba1-40e4-4f15-9e41-eaa484811017 tempest-GroupsV314Test-79443452 None] Created reservations ['762a6099-91c0-4933-b77d-7d655d7b0534'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:17:18 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-078d6ba1-40e4-4f15-9e41-eaa484811017 tempest-GroupsV314Test-79443452 None] Created reservations ['bf4dbbb5-eece-404f-8378-5ef8735d913f', 'a5b08d7d-de77-4f3d-b236-e6ec5e84dcb5', 'd5e98e82-2be7-4b66-97b2-45f4e288aeef', '3b9816b0-d7ef-4e73-a430-d707c446be48'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:17:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-078d6ba1-40e4-4f15-9e41-eaa484811017 tempest-GroupsV314Test-79443452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-078d6ba1-40e4-4f15-9e41-eaa484811017 tempest-GroupsV314Test-79443452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:18 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-078d6ba1-40e4-4f15-9e41-eaa484811017 tempest-GroupsV314Test-79443452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:17:18 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-078d6ba1-40e4-4f15-9e41-eaa484811017 tempest-GroupsV314Test-79443452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:17:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-078d6ba1-40e4-4f15-9e41-eaa484811017 tempest-GroupsV314Test-79443452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-078d6ba1-40e4-4f15-9e41-eaa484811017 tempest-GroupsV314Test-79443452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:18 devstack sudo[99228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:17:18 devstack sudo[99228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:19 devstack sudo[99228]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-078d6ba1-40e4-4f15-9e41-eaa484811017 tempest-GroupsV314Test-79443452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.370s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:19 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-078d6ba1-40e4-4f15-9e41-eaa484811017 tempest-GroupsV314Test-79443452 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:17:19 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-078d6ba1-40e4-4f15-9e41-eaa484811017 tempest-GroupsV314Test-79443452 None] Delete group completed successfully. Nov 03 13:17:19 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-82e1aa87-e757-4048-91de-9bfd40f40813 tempest-VolumesTransfersV355Test-2145229069 None] Transfer volume completed successfully. Nov 03 13:17:20 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-3d1ba348-354d-4ae3-99fa-382ec286c3e3 req-26f94d74-17ff-44c5-9016-4e6b1b12e586 tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Terminate volume connection completed successfully. Nov 03 13:17:20 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-3d1ba348-354d-4ae3-99fa-382ec286c3e3 req-26f94d74-17ff-44c5-9016-4e6b1b12e586 tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Deleting attachment 3a10acff-6a7b-40dc-8ff0-f8a93d164621. {{(pid=86725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:17:20 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b5162ea2-4ac2-489d-a200-48a0acb79326 tempest-VolumesTransfersV355Test-1345232444 None] Acquiring lock "cinder-50d53272-3f82-4e53-9540-f52578934672-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:17:20 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b5162ea2-4ac2-489d-a200-48a0acb79326 tempest-VolumesTransfersV355Test-1345232444 None] Lock "cinder-50d53272-3f82-4e53-9540-f52578934672-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:17:20 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b5162ea2-4ac2-489d-a200-48a0acb79326 tempest-VolumesTransfersV355Test-1345232444 None] Acquiring lock "cinder-quobyte-50d53272-3f82-4e53-9540-f52578934672" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:17:20 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b5162ea2-4ac2-489d-a200-48a0acb79326 tempest-VolumesTransfersV355Test-1345232444 None] Lock "cinder-quobyte-50d53272-3f82-4e53-9540-f52578934672" acquired by "delete_volume" :: waited 0.021s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:17:20 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e46a6d7-d59d-4dd0-96e4-ed8df8f57f5c]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:17:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b5162ea2-4ac2-489d-a200-48a0acb79326 tempest-VolumesTransfersV355Test-1345232444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-50d53272-3f82-4e53-9540-f52578934672 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:20 devstack sudo[99239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-50d53272-3f82-4e53-9540-f52578934672 Nov 03 13:17:20 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:20 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b5162ea2-4ac2-489d-a200-48a0acb79326 tempest-VolumesTransfersV355Test-1345232444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-50d53272-3f82-4e53-9540-f52578934672" returned: 0 in 0.475s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b5162ea2-4ac2-489d-a200-48a0acb79326 tempest-VolumesTransfersV355Test-1345232444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-50d53272-3f82-4e53-9540-f52578934672 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:21 devstack sudo[99244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-50d53272-3f82-4e53-9540-f52578934672 Nov 03 13:17:21 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:21 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d54bfa79-21fa-40a2-93ad-01beeff98c6b tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Acquiring lock "cinder-fa65b7fe-97a9-4a02-9836-7dbf2becd3b1-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:17:21 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d54bfa79-21fa-40a2-93ad-01beeff98c6b tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Lock "cinder-fa65b7fe-97a9-4a02-9836-7dbf2becd3b1-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:17:21 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d54bfa79-21fa-40a2-93ad-01beeff98c6b tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Acquiring lock "cinder-quobyte-fa65b7fe-97a9-4a02-9836-7dbf2becd3b1" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:17:21 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d54bfa79-21fa-40a2-93ad-01beeff98c6b tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Lock "cinder-quobyte-fa65b7fe-97a9-4a02-9836-7dbf2becd3b1" acquired by "delete_volume" :: waited 0.021s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:17:21 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9249a3-0667-4b6c-bd87-4a029cdfea17]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:17:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d54bfa79-21fa-40a2-93ad-01beeff98c6b tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-fa65b7fe-97a9-4a02-9836-7dbf2becd3b1 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:21 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b5162ea2-4ac2-489d-a200-48a0acb79326 tempest-VolumesTransfersV355Test-1345232444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-50d53272-3f82-4e53-9540-f52578934672" returned: 0 in 0.431s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:21 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b5162ea2-4ac2-489d-a200-48a0acb79326 tempest-VolumesTransfersV355Test-1345232444 None] Lock "cinder-quobyte-50d53272-3f82-4e53-9540-f52578934672" released by "delete_volume" :: held 0.971s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:17:21 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-b5162ea2-4ac2-489d-a200-48a0acb79326 tempest-VolumesTransfersV355Test-1345232444 None] Created reservations ['5368c371-7b95-4cfd-900a-0f6361fc4b17', '1aee3ebc-34bc-4c76-8963-db6fd21964eb', 'aa3c05e6-071c-44b2-8c85-3ec5151d5b3f', '02e07e49-2b44-4390-a298-90dcbae9d8ca'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:17:21 devstack sudo[99249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-fa65b7fe-97a9-4a02-9836-7dbf2becd3b1 Nov 03 13:17:21 devstack sudo[99249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b5162ea2-4ac2-489d-a200-48a0acb79326 tempest-VolumesTransfersV355Test-1345232444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b5162ea2-4ac2-489d-a200-48a0acb79326 tempest-VolumesTransfersV355Test-1345232444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:21 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b5162ea2-4ac2-489d-a200-48a0acb79326 tempest-VolumesTransfersV355Test-1345232444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:17:21 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b5162ea2-4ac2-489d-a200-48a0acb79326 tempest-VolumesTransfersV355Test-1345232444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:17:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b5162ea2-4ac2-489d-a200-48a0acb79326 tempest-VolumesTransfersV355Test-1345232444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b5162ea2-4ac2-489d-a200-48a0acb79326 tempest-VolumesTransfersV355Test-1345232444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:21 devstack sudo[99251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:17:21 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:21 devstack sudo[99249]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d54bfa79-21fa-40a2-93ad-01beeff98c6b tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-fa65b7fe-97a9-4a02-9836-7dbf2becd3b1" returned: 0 in 0.560s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d54bfa79-21fa-40a2-93ad-01beeff98c6b tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-fa65b7fe-97a9-4a02-9836-7dbf2becd3b1 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:21 devstack sudo[99257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-fa65b7fe-97a9-4a02-9836-7dbf2becd3b1 Nov 03 13:17:21 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:22 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b5162ea2-4ac2-489d-a200-48a0acb79326 tempest-VolumesTransfersV355Test-1345232444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.412s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:22 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-b5162ea2-4ac2-489d-a200-48a0acb79326 tempest-VolumesTransfersV355Test-1345232444 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:17:22 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-b5162ea2-4ac2-489d-a200-48a0acb79326 tempest-VolumesTransfersV355Test-1345232444 None] Deleted volume successfully. Nov 03 13:17:22 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b5162ea2-4ac2-489d-a200-48a0acb79326 tempest-VolumesTransfersV355Test-1345232444 None] Lock "cinder-50d53272-3f82-4e53-9540-f52578934672-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:17:22 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d54bfa79-21fa-40a2-93ad-01beeff98c6b tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-fa65b7fe-97a9-4a02-9836-7dbf2becd3b1" returned: 0 in 0.354s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:22 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d54bfa79-21fa-40a2-93ad-01beeff98c6b tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Lock "cinder-quobyte-fa65b7fe-97a9-4a02-9836-7dbf2becd3b1" released by "delete_volume" :: held 0.999s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:17:22 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-d54bfa79-21fa-40a2-93ad-01beeff98c6b tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Created reservations ['5a6537fe-0483-42a8-99da-ba2c527e660e', 'bb161fe9-303f-4622-a14f-166877468885', '7482f125-a9bf-4bde-abab-ef84f457eae8', 'ad30dc7f-e494-410e-9ddb-3bc0e7232bbc'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:17:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d54bfa79-21fa-40a2-93ad-01beeff98c6b tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d54bfa79-21fa-40a2-93ad-01beeff98c6b tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:22 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d54bfa79-21fa-40a2-93ad-01beeff98c6b tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:17:22 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d54bfa79-21fa-40a2-93ad-01beeff98c6b tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:17:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d54bfa79-21fa-40a2-93ad-01beeff98c6b tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d54bfa79-21fa-40a2-93ad-01beeff98c6b tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:22 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:17:22 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:17:22 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] Flow 'volume_create_manager' (af1df08b-c08b-4e36-a969-f4e0eb1b9d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:17:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e56aad80-132f-4393-b89c-a3e0fa3f5eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e56aad80-132f-4393-b89c-a3e0fa3f5eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2113227519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec515c1-ff28-4ef2-a67b-2e23f11386bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35fa48e2d984f5a9778fc249fde1b00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:17:23Z,use_quota=True,user_id='cba7e56048f4417fa7e86e37da578d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb1feb5a-575e-4380-b58c-64cb598f1d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb1feb5a-575e-4380-b58c-64cb598f1d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6283886-bba2-46f0-ad97-3366bc80e0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6283886-bba2-46f0-ad97-3366bc80e0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ec515c1-ff28-4ef2-a67b-2e23f11386bb', 'volume_name': 'volume-7ec515c1-ff28-4ef2-a67b-2e23f11386bb', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed0f5ff-921d-48cc-a0e3-9929d56626df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed0f5ff-921d-48cc-a0e3-9929d56626df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a33cbee2-c9e3-480f-935b-deca48ec0708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:22 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] Volume 7ec515c1-ff28-4ef2-a67b-2e23f11386bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ec515c1-ff28-4ef2-a67b-2e23f11386bb', 'volume_size': 1} Nov 03 13:17:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:22 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2113227519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec515c1-ff28-4ef2-a67b-2e23f11386bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35fa48e2d984f5a9778fc249fde1b00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:17:23Z,use_quota=True,user_id='cba7e56048f4417fa7e86e37da578d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:17:22 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] Creating volume 7ec515c1-ff28-4ef2-a67b-2e23f11386bb {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:17:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:22 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:17:22 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:17:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:22 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:17:22 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:17:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7ec515c1-ff28-4ef2-a67b-2e23f11386bb 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:22 devstack sudo[99263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7ec515c1-ff28-4ef2-a67b-2e23f11386bb 1073741824 Nov 03 13:17:22 devstack sudo[99263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:23 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d54bfa79-21fa-40a2-93ad-01beeff98c6b tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.405s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:23 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-d54bfa79-21fa-40a2-93ad-01beeff98c6b tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:17:23 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-d54bfa79-21fa-40a2-93ad-01beeff98c6b tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Deleted volume successfully. Nov 03 13:17:23 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d54bfa79-21fa-40a2-93ad-01beeff98c6b tempest-TestServerVolumeAttachScenarioOldVersion-87317444 None] Lock "cinder-fa65b7fe-97a9-4a02-9836-7dbf2becd3b1-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:17:23 devstack sudo[99263]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7ec515c1-ff28-4ef2-a67b-2e23f11386bb 1073741824" returned: 0 in 0.594s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7ec515c1-ff28-4ef2-a67b-2e23f11386bb {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:23 devstack sudo[99270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7ec515c1-ff28-4ef2-a67b-2e23f11386bb Nov 03 13:17:23 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:23 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7ec515c1-ff28-4ef2-a67b-2e23f11386bb" returned: 0 in 0.386s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:23 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:17:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:23 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a33cbee2-c9e3-480f-935b-deca48ec0708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ec515c1-ff28-4ef2-a67b-2e23f11386bb', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:23 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed77968d-5dfe-44bf-9bee-035d3aafb23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:23 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] Volume volume-7ec515c1-ff28-4ef2-a67b-2e23f11386bb (7ec515c1-ff28-4ef2-a67b-2e23f11386bb): created successfully Nov 03 13:17:23 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed77968d-5dfe-44bf-9bee-035d3aafb23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:23 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] Flow 'volume_create_manager' (af1df08b-c08b-4e36-a969-f4e0eb1b9d3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:17:23 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-351e474e-1287-48d6-b1d0-66e4bc27e19f tempest-VolumesTransfersV355Test-1210689020 None] Created volume successfully. Nov 03 13:17:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-14ec354d-1773-47f1-8cb2-57b462670868 tempest-VolumesTransfersV355Test-1345232444 None] Acquiring lock "cinder-7ec515c1-ff28-4ef2-a67b-2e23f11386bb-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:17:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-14ec354d-1773-47f1-8cb2-57b462670868 tempest-VolumesTransfersV355Test-1345232444 None] Lock "cinder-7ec515c1-ff28-4ef2-a67b-2e23f11386bb-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:17:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-14ec354d-1773-47f1-8cb2-57b462670868 tempest-VolumesTransfersV355Test-1345232444 None] Acquiring lock "cinder-quobyte-7ec515c1-ff28-4ef2-a67b-2e23f11386bb" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:17:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-14ec354d-1773-47f1-8cb2-57b462670868 tempest-VolumesTransfersV355Test-1345232444 None] Lock "cinder-quobyte-7ec515c1-ff28-4ef2-a67b-2e23f11386bb" acquired by "delete_volume" :: waited 0.019s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:17:25 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[89eaa0c7-f3be-4955-82d4-0e23d0a79d77]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:17:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-14ec354d-1773-47f1-8cb2-57b462670868 tempest-VolumesTransfersV355Test-1345232444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7ec515c1-ff28-4ef2-a67b-2e23f11386bb {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:25 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7ec515c1-ff28-4ef2-a67b-2e23f11386bb Nov 03 13:17:25 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:25 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-14ec354d-1773-47f1-8cb2-57b462670868 tempest-VolumesTransfersV355Test-1345232444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7ec515c1-ff28-4ef2-a67b-2e23f11386bb" returned: 0 in 0.538s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-14ec354d-1773-47f1-8cb2-57b462670868 tempest-VolumesTransfersV355Test-1345232444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7ec515c1-ff28-4ef2-a67b-2e23f11386bb {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:26 devstack sudo[99310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7ec515c1-ff28-4ef2-a67b-2e23f11386bb Nov 03 13:17:26 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:26 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-14ec354d-1773-47f1-8cb2-57b462670868 tempest-VolumesTransfersV355Test-1345232444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7ec515c1-ff28-4ef2-a67b-2e23f11386bb" returned: 0 in 0.427s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:26 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-14ec354d-1773-47f1-8cb2-57b462670868 tempest-VolumesTransfersV355Test-1345232444 None] Lock "cinder-quobyte-7ec515c1-ff28-4ef2-a67b-2e23f11386bb" released by "delete_volume" :: held 1.053s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:17:26 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-14ec354d-1773-47f1-8cb2-57b462670868 tempest-VolumesTransfersV355Test-1345232444 None] Created reservations ['e6fa8146-f992-4d9b-8b6e-2c5e61013f90', '3671f0a7-01d5-4d3a-b05a-26829079ed1e', '87c50492-109f-4d37-a7ce-2b29996a2e5d', 'f4887fee-dac3-4a8e-8626-d3226967d702'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:17:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-14ec354d-1773-47f1-8cb2-57b462670868 tempest-VolumesTransfersV355Test-1345232444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-14ec354d-1773-47f1-8cb2-57b462670868 tempest-VolumesTransfersV355Test-1345232444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-14ec354d-1773-47f1-8cb2-57b462670868 tempest-VolumesTransfersV355Test-1345232444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:17:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-14ec354d-1773-47f1-8cb2-57b462670868 tempest-VolumesTransfersV355Test-1345232444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:17:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-14ec354d-1773-47f1-8cb2-57b462670868 tempest-VolumesTransfersV355Test-1345232444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-14ec354d-1773-47f1-8cb2-57b462670868 tempest-VolumesTransfersV355Test-1345232444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:26 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:17:26 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:26 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-14ec354d-1773-47f1-8cb2-57b462670868 tempest-VolumesTransfersV355Test-1345232444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.294s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:26 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-14ec354d-1773-47f1-8cb2-57b462670868 tempest-VolumesTransfersV355Test-1345232444 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:17:26 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-14ec354d-1773-47f1-8cb2-57b462670868 tempest-VolumesTransfersV355Test-1345232444 None] Deleted volume successfully. Nov 03 13:17:27 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-14ec354d-1773-47f1-8cb2-57b462670868 tempest-VolumesTransfersV355Test-1345232444 None] Lock "cinder-7ec515c1-ff28-4ef2-a67b-2e23f11386bb-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:17:30 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:17:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] Flow 'volume_create_manager' (f9e1fbb1-19c0-4a16-bf4c-3493e8ee5a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:17:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (299c7013-35c9-4584-916d-934f3e2fc9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (299c7013-35c9-4584-916d-934f3e2fc9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1512847538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8882746e-53e4-423d-8513-07f07d87bced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e2a288c5e9a4b1dbcb4252afd1f191c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:17:30Z,use_quota=True,user_id='a0aae09cf6e942e4bfd8d96e79f799ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a656573c-5661-41ec-914c-e05de5c58d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a656573c-5661-41ec-914c-e05de5c58d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe5b9d22-98db-40fc-9d0a-c9d0cd6f577e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe5b9d22-98db-40fc-9d0a-c9d0cd6f577e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8882746e-53e4-423d-8513-07f07d87bced', 'volume_name': 'volume-8882746e-53e4-423d-8513-07f07d87bced', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (109d6bbf-8e99-4cea-bb06-ae80b6171b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (109d6bbf-8e99-4cea-bb06-ae80b6171b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e48c796-b1af-4661-8cf3-842c03b62de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:30 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] Volume 8882746e-53e4-423d-8513-07f07d87bced: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8882746e-53e4-423d-8513-07f07d87bced', 'volume_size': 1} Nov 03 13:17:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:30 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1512847538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8882746e-53e4-423d-8513-07f07d87bced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e2a288c5e9a4b1dbcb4252afd1f191c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:17:30Z,use_quota=True,user_id='a0aae09cf6e942e4bfd8d96e79f799ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:17:30 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] Creating volume 8882746e-53e4-423d-8513-07f07d87bced {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:17:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:30 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:17:30 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:17:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:30 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:17:30 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:17:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8882746e-53e4-423d-8513-07f07d87bced 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:30 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8882746e-53e4-423d-8513-07f07d87bced 1073741824 Nov 03 13:17:30 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:30 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8882746e-53e4-423d-8513-07f07d87bced 1073741824" returned: 0 in 0.604s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8882746e-53e4-423d-8513-07f07d87bced {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:30 devstack sudo[99328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8882746e-53e4-423d-8513-07f07d87bced Nov 03 13:17:30 devstack sudo[99328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:31 devstack sudo[99328]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8882746e-53e4-423d-8513-07f07d87bced" returned: 0 in 0.362s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:31 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:17:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e48c796-b1af-4661-8cf3-842c03b62de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8882746e-53e4-423d-8513-07f07d87bced', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cdf6679-d38a-4fed-ace2-18844ac557d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:31 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] Volume volume-8882746e-53e4-423d-8513-07f07d87bced (8882746e-53e4-423d-8513-07f07d87bced): created successfully Nov 03 13:17:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cdf6679-d38a-4fed-ace2-18844ac557d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] Flow 'volume_create_manager' (f9e1fbb1-19c0-4a16-bf4c-3493e8ee5a0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:17:31 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-0006bac7-0542-4666-b40c-e6ce3ceb1499 tempest-VolumeQuotasAdminTestJSON-569462093 None] Created volume successfully. Nov 03 13:17:32 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-da6d034a-e708-443d-b54f-e49fb6030e9c tempest-VolumeQuotasAdminTestJSON-569462093 None] Acquiring lock "cinder-8882746e-53e4-423d-8513-07f07d87bced-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:17:32 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-da6d034a-e708-443d-b54f-e49fb6030e9c tempest-VolumeQuotasAdminTestJSON-569462093 None] Lock "cinder-8882746e-53e4-423d-8513-07f07d87bced-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:17:32 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-da6d034a-e708-443d-b54f-e49fb6030e9c tempest-VolumeQuotasAdminTestJSON-569462093 None] Acquiring lock "cinder-quobyte-8882746e-53e4-423d-8513-07f07d87bced" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:17:32 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-da6d034a-e708-443d-b54f-e49fb6030e9c tempest-VolumeQuotasAdminTestJSON-569462093 None] Lock "cinder-quobyte-8882746e-53e4-423d-8513-07f07d87bced" acquired by "delete_volume" :: waited 0.041s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:17:32 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8975fd-8719-4874-9312-4e7e5cf390c9]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:17:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-da6d034a-e708-443d-b54f-e49fb6030e9c tempest-VolumeQuotasAdminTestJSON-569462093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8882746e-53e4-423d-8513-07f07d87bced {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:32 devstack sudo[99332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8882746e-53e4-423d-8513-07f07d87bced Nov 03 13:17:32 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:32 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-da6d034a-e708-443d-b54f-e49fb6030e9c tempest-VolumeQuotasAdminTestJSON-569462093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8882746e-53e4-423d-8513-07f07d87bced" returned: 0 in 0.449s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-da6d034a-e708-443d-b54f-e49fb6030e9c tempest-VolumeQuotasAdminTestJSON-569462093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8882746e-53e4-423d-8513-07f07d87bced {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:32 devstack sudo[99338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8882746e-53e4-423d-8513-07f07d87bced Nov 03 13:17:32 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:33 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-da6d034a-e708-443d-b54f-e49fb6030e9c tempest-VolumeQuotasAdminTestJSON-569462093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8882746e-53e4-423d-8513-07f07d87bced" returned: 0 in 0.289s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:33 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-da6d034a-e708-443d-b54f-e49fb6030e9c tempest-VolumeQuotasAdminTestJSON-569462093 None] Lock "cinder-quobyte-8882746e-53e4-423d-8513-07f07d87bced" released by "delete_volume" :: held 0.847s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:17:33 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-da6d034a-e708-443d-b54f-e49fb6030e9c tempest-VolumeQuotasAdminTestJSON-569462093 None] Created reservations ['53517f0c-6918-4442-a3cc-b09db5504573', 'c53128ec-659e-45ca-a0a1-488648af9c03', 'e23ab1bd-e94a-43d5-9a9b-b0ded8117b01', 'f2bb90d9-244a-4175-8638-ca24fbdb862a'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:17:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-da6d034a-e708-443d-b54f-e49fb6030e9c tempest-VolumeQuotasAdminTestJSON-569462093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-da6d034a-e708-443d-b54f-e49fb6030e9c tempest-VolumeQuotasAdminTestJSON-569462093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:33 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-da6d034a-e708-443d-b54f-e49fb6030e9c tempest-VolumeQuotasAdminTestJSON-569462093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:17:33 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-da6d034a-e708-443d-b54f-e49fb6030e9c tempest-VolumeQuotasAdminTestJSON-569462093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:17:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-da6d034a-e708-443d-b54f-e49fb6030e9c tempest-VolumeQuotasAdminTestJSON-569462093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-da6d034a-e708-443d-b54f-e49fb6030e9c tempest-VolumeQuotasAdminTestJSON-569462093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:33 devstack sudo[99341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:17:33 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:33 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-da6d034a-e708-443d-b54f-e49fb6030e9c tempest-VolumeQuotasAdminTestJSON-569462093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.554s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:33 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-da6d034a-e708-443d-b54f-e49fb6030e9c tempest-VolumeQuotasAdminTestJSON-569462093 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:17:34 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-da6d034a-e708-443d-b54f-e49fb6030e9c tempest-VolumeQuotasAdminTestJSON-569462093 None] Deleted volume successfully. Nov 03 13:17:34 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-da6d034a-e708-443d-b54f-e49fb6030e9c tempest-VolumeQuotasAdminTestJSON-569462093 None] Lock "cinder-8882746e-53e4-423d-8513-07f07d87bced-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:17:34 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:17:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] Flow 'volume_create_manager' (ee46ea6a-70e9-43e7-a0b1-331d6c1abe9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:17:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc8fd409-51af-4d7e-a614-405ffe436169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc8fd409-51af-4d7e-a614-405ffe436169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1261847732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4648ca4-cdb8-464f-b25e-53c7739b79ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e2a288c5e9a4b1dbcb4252afd1f191c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:17:34Z,use_quota=True,user_id='a0aae09cf6e942e4bfd8d96e79f799ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087e5888-3c55-4565-9d25-f86ff900208b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087e5888-3c55-4565-9d25-f86ff900208b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc0f4451-6620-467a-ac0e-d56cc2934f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc0f4451-6620-467a-ac0e-d56cc2934f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4648ca4-cdb8-464f-b25e-53c7739b79ad', 'volume_name': 'volume-f4648ca4-cdb8-464f-b25e-53c7739b79ad', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa131967-4ea4-4781-aad2-3aac407a812c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa131967-4ea4-4781-aad2-3aac407a812c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (413d38b1-acd5-4329-a679-d86c2b5535f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:34 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] Volume f4648ca4-cdb8-464f-b25e-53c7739b79ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4648ca4-cdb8-464f-b25e-53c7739b79ad', 'volume_size': 1} Nov 03 13:17:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:34 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1261847732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4648ca4-cdb8-464f-b25e-53c7739b79ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e2a288c5e9a4b1dbcb4252afd1f191c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:17:34Z,use_quota=True,user_id='a0aae09cf6e942e4bfd8d96e79f799ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:17:34 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] Creating volume f4648ca4-cdb8-464f-b25e-53c7739b79ad {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:17:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:34 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:17:34 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:17:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:34 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:17:34 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:17:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f4648ca4-cdb8-464f-b25e-53c7739b79ad 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:34 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f4648ca4-cdb8-464f-b25e-53c7739b79ad 1073741824 Nov 03 13:17:34 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:35 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f4648ca4-cdb8-464f-b25e-53c7739b79ad 1073741824" returned: 0 in 0.552s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f4648ca4-cdb8-464f-b25e-53c7739b79ad {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:35 devstack sudo[99350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f4648ca4-cdb8-464f-b25e-53c7739b79ad Nov 03 13:17:35 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:35 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f4648ca4-cdb8-464f-b25e-53c7739b79ad" returned: 0 in 0.376s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:35 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:17:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:35 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (413d38b1-acd5-4329-a679-d86c2b5535f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4648ca4-cdb8-464f-b25e-53c7739b79ad', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:35 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72715dc0-da70-4366-a7c8-369b9e23f067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:35 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] Volume volume-f4648ca4-cdb8-464f-b25e-53c7739b79ad (f4648ca4-cdb8-464f-b25e-53c7739b79ad): created successfully Nov 03 13:17:35 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72715dc0-da70-4366-a7c8-369b9e23f067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:35 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] Flow 'volume_create_manager' (ee46ea6a-70e9-43e7-a0b1-331d6c1abe9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:17:35 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-9416518a-5814-4e0b-b287-e4a03902a64d tempest-VolumeQuotasAdminTestJSON-569462093 None] Created volume successfully. Nov 03 13:17:37 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:17:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Flow 'volume_create_manager' (c852aa5b-4e2b-4a01-9311-489bb2292436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:17:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6ebdb1-65cc-4a8e-895b-c01eae38ebc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6ebdb1-65cc-4a8e-895b-c01eae38ebc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-516017551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7701f927-ace7-4310-9a77-d5f9aaaa32ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbfe907704b34e61aab2f8fb9e66c4b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:17:37Z,use_quota=True,user_id='9fe0e64314e54e649d06c0354c40e79a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d64244ac-a5a3-45c4-8050-00a3af702b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d64244ac-a5a3-45c4-8050-00a3af702b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (768e9def-edff-4c1c-b7e9-0073cd3c360c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:37 devstack cinder-volume[86725]: DEBUG cinder.image.glance [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Creating Keystone auth plugin from conf {{(pid=86725) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 13:17:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (768e9def-edff-4c1c-b7e9-0073cd3c360c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7701f927-ace7-4310-9a77-d5f9aaaa32ba', 'volume_name': 'volume-7701f927-ace7-4310-9a77-d5f9aaaa32ba', 'volume_size': 1, 'image_id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8a9fdfe427f436894d9c81085f9b6d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'created_at': datetime.datetime(2026, 11, 3, 12, 0, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 0, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c777673-2092-491a-a0c5-3d56c8589060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c777673-2092-491a-a0c5-3d56c8589060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ad9d49-4e67-4dd7-a0dc-8e5380034a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:37 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Volume 7701f927-ace7-4310-9a77-d5f9aaaa32ba: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7701f927-ace7-4310-9a77-d5f9aaaa32ba', 'volume_size': 1, 'image_id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8a9fdfe427f436894d9c81085f9b6d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'created_at': datetime.datetime(2026, 11, 3, 12, 0, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 0, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 13:17:37 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Trying to clone 7701f927-ace7-4310-9a77-d5f9aaaa32ba from image d23bcc2f-7dfc-45dc-b259-aec67f909b4f at location (None, [{'url': 'file:///opt/stack/data/glance/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'metadata': {}}]). {{(pid=86725) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 13:17:37 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-51ed083e-8408-4335-be1b-3f8dd634ee74 tempest-VolumeQuotasAdminTestJSON-1085109667 None] Transfer volume completed successfully. Nov 03 13:17:37 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_gunqojjodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86725) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 13:17:37 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Image download 20.69 MB at 20.69 MB/s Nov 03 13:17:37 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[e062def6-3788-4095-8739-97cc85586699]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:17:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_gunqojjodevstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:38 devstack sudo[99381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_gunqojjodevstack@QuobyteHD Nov 03 13:17:38 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:38 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-daa0268e-20fa-42f2-b14a-5a4b4a5659e8 tempest-VolumeQuotasAdminTestJSON-661231419 None] Acquiring lock "cinder-f4648ca4-cdb8-464f-b25e-53c7739b79ad-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:17:38 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-daa0268e-20fa-42f2-b14a-5a4b4a5659e8 tempest-VolumeQuotasAdminTestJSON-661231419 None] Lock "cinder-f4648ca4-cdb8-464f-b25e-53c7739b79ad-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:17:38 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-daa0268e-20fa-42f2-b14a-5a4b4a5659e8 tempest-VolumeQuotasAdminTestJSON-661231419 None] Acquiring lock "cinder-quobyte-f4648ca4-cdb8-464f-b25e-53c7739b79ad" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:17:38 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-daa0268e-20fa-42f2-b14a-5a4b4a5659e8 tempest-VolumeQuotasAdminTestJSON-661231419 None] Lock "cinder-quobyte-f4648ca4-cdb8-464f-b25e-53c7739b79ad" acquired by "delete_volume" :: waited 0.032s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:17:38 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[5472590e-521f-481e-9dfa-6b004a9be2f4]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:17:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-daa0268e-20fa-42f2-b14a-5a4b4a5659e8 tempest-VolumeQuotasAdminTestJSON-661231419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f4648ca4-cdb8-464f-b25e-53c7739b79ad {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:38 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_gunqojjodevstack@QuobyteHD" returned: 0 in 0.449s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:38 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Temporary image d23bcc2f-7dfc-45dc-b259-aec67f909b4f is fetched for user 9fe0e64314e54e649d06c0354c40e79a. {{(pid=86725) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 13:17:38 devstack sudo[99383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f4648ca4-cdb8-464f-b25e-53c7739b79ad Nov 03 13:17:38 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:38 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[d887305d-9b1d-42aa-ad11-f430e50f1374]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:17:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_gunqojjodevstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:38 devstack sudo[99388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_gunqojjodevstack@QuobyteHD Nov 03 13:17:38 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:38 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-daa0268e-20fa-42f2-b14a-5a4b4a5659e8 tempest-VolumeQuotasAdminTestJSON-661231419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f4648ca4-cdb8-464f-b25e-53c7739b79ad" returned: 0 in 0.396s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-daa0268e-20fa-42f2-b14a-5a4b4a5659e8 tempest-VolumeQuotasAdminTestJSON-661231419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f4648ca4-cdb8-464f-b25e-53c7739b79ad {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:38 devstack sudo[99393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f4648ca4-cdb8-464f-b25e-53c7739b79ad Nov 03 13:17:38 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:38 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_gunqojjodevstack@QuobyteHD" returned: 0 in 0.361s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:38 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-516017551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7701f927-ace7-4310-9a77-d5f9aaaa32ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbfe907704b34e61aab2f8fb9e66c4b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:17:37Z,use_quota=True,user_id='9fe0e64314e54e649d06c0354c40e79a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:17:38 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Creating volume 7701f927-ace7-4310-9a77-d5f9aaaa32ba {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:17:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:38 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:17:38 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:17:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:38 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:17:38 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:17:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7701f927-ace7-4310-9a77-d5f9aaaa32ba 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:38 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7701f927-ace7-4310-9a77-d5f9aaaa32ba 1073741824 Nov 03 13:17:38 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:38 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-daa0268e-20fa-42f2-b14a-5a4b4a5659e8 tempest-VolumeQuotasAdminTestJSON-661231419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f4648ca4-cdb8-464f-b25e-53c7739b79ad" returned: 0 in 0.300s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:39 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-daa0268e-20fa-42f2-b14a-5a4b4a5659e8 tempest-VolumeQuotasAdminTestJSON-661231419 None] Lock "cinder-quobyte-f4648ca4-cdb8-464f-b25e-53c7739b79ad" released by "delete_volume" :: held 0.762s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:17:39 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-daa0268e-20fa-42f2-b14a-5a4b4a5659e8 tempest-VolumeQuotasAdminTestJSON-661231419 None] Created reservations ['d9819385-829b-4c39-9abd-75a1b21fbf13', '41d486cb-5741-44c2-8042-3d0254d4fc37', 'faea7619-575c-481e-add5-89d395733e13', 'aaf4e50b-c085-47a6-ae65-d62c781304a1'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:17:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-daa0268e-20fa-42f2-b14a-5a4b4a5659e8 tempest-VolumeQuotasAdminTestJSON-661231419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-daa0268e-20fa-42f2-b14a-5a4b4a5659e8 tempest-VolumeQuotasAdminTestJSON-661231419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:39 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-daa0268e-20fa-42f2-b14a-5a4b4a5659e8 tempest-VolumeQuotasAdminTestJSON-661231419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:17:39 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-daa0268e-20fa-42f2-b14a-5a4b4a5659e8 tempest-VolumeQuotasAdminTestJSON-661231419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:17:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-daa0268e-20fa-42f2-b14a-5a4b4a5659e8 tempest-VolumeQuotasAdminTestJSON-661231419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-daa0268e-20fa-42f2-b14a-5a4b4a5659e8 tempest-VolumeQuotasAdminTestJSON-661231419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:39 devstack sudo[99404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:17:39 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:39 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7701f927-ace7-4310-9a77-d5f9aaaa32ba 1073741824" returned: 0 in 0.613s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:39 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-daa0268e-20fa-42f2-b14a-5a4b4a5659e8 tempest-VolumeQuotasAdminTestJSON-661231419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.323s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:39 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-daa0268e-20fa-42f2-b14a-5a4b4a5659e8 tempest-VolumeQuotasAdminTestJSON-661231419 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:17:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7701f927-ace7-4310-9a77-d5f9aaaa32ba {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:39 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-daa0268e-20fa-42f2-b14a-5a4b4a5659e8 tempest-VolumeQuotasAdminTestJSON-661231419 None] Deleted volume successfully. Nov 03 13:17:39 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7701f927-ace7-4310-9a77-d5f9aaaa32ba Nov 03 13:17:39 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:39 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-daa0268e-20fa-42f2-b14a-5a4b4a5659e8 tempest-VolumeQuotasAdminTestJSON-661231419 None] Lock "cinder-f4648ca4-cdb8-464f-b25e-53c7739b79ad-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:17:39 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7701f927-ace7-4310-9a77-d5f9aaaa32ba" returned: 0 in 0.300s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:39 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:17:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:39 devstack cinder-volume[86725]: DEBUG cinder.volume.volume_utils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Attempting download of d23bcc2f-7dfc-45dc-b259-aec67f909b4f ((None, [{'url': 'file:///opt/stack/data/glance/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'metadata': {}}])) to volume 7701f927-ace7-4310-9a77-d5f9aaaa32ba. {{(pid=86725) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 13:17:39 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[be946af7-2196-434b-9bc7-a14f4605ef90]: (4, 'raw') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:17:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_mh35rr_a {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:40 devstack sudo[99411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_mh35rr_a Nov 03 13:17:40 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:40 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_mh35rr_a" returned: 0 in 0.361s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_mh35rr_a {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:40 devstack sudo[99415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_mh35rr_a Nov 03 13:17:40 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:40 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_mh35rr_a" returned: 1 in 0.333s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_mh35rr_a' failed. Not Retrying. {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:17:40 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fc37a0-e74d-4eef-a30b-c6ee16f40cdc]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:17:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_gunqojjodevstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:40 devstack sudo[99419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_gunqojjodevstack@QuobyteHD Nov 03 13:17:40 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:41 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_gunqojjodevstack@QuobyteHD" returned: 0 in 0.456s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:41 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] d23bcc2f-7dfc-45dc-b259-aec67f909b4f was qcow2, converting to qcow2 {{(pid=86725) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 13:17:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_gunqojjodevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7701f927-ace7-4310-9a77-d5f9aaaa32ba {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:41 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_gunqojjodevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7701f927-ace7-4310-9a77-d5f9aaaa32ba Nov 03 13:17:41 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:43 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_gunqojjodevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7701f927-ace7-4310-9a77-d5f9aaaa32ba" returned: 0 in 2.403s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:43 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_gunqojjodevstack@QuobyteHD, size 112.00 MB, duration 2.40 sec, destination /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7701f927-ace7-4310-9a77-d5f9aaaa32ba {{(pid=86725) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:17:43 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Converted 112.00 MB image at 46.59 MB/s Nov 03 13:17:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7701f927-ace7-4310-9a77-d5f9aaaa32ba 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:43 devstack sudo[99435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7701f927-ace7-4310-9a77-d5f9aaaa32ba 1G Nov 03 13:17:43 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:43 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7701f927-ace7-4310-9a77-d5f9aaaa32ba 1G" returned: 0 in 0.424s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:43 devstack cinder-volume[86725]: DEBUG cinder.volume.volume_utils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Downloaded image d23bcc2f-7dfc-45dc-b259-aec67f909b4f ((None, [{'url': 'file:///opt/stack/data/glance/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'metadata': {}}])) to volume 7701f927-ace7-4310-9a77-d5f9aaaa32ba successfully. {{(pid=86725) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 13:17:43 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Temporary image d23bcc2f-7dfc-45dc-b259-aec67f909b4f for user 9fe0e64314e54e649d06c0354c40e79a is deleted. {{(pid=86725) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 13:17:43 devstack cinder-volume[86725]: DEBUG cinder.volume.volume_utils [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Marking volume 7701f927-ace7-4310-9a77-d5f9aaaa32ba as bootable. {{(pid=86725) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 13:17:43 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Copying metadata from image d23bcc2f-7dfc-45dc-b259-aec67f909b4f to 7701f927-ace7-4310-9a77-d5f9aaaa32ba. {{(pid=86725) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 13:17:43 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Creating volume glance metadata for volume 7701f927-ace7-4310-9a77-d5f9aaaa32ba backed by image d23bcc2f-7dfc-45dc-b259-aec67f909b4f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86725) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 13:17:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ad9d49-4e67-4dd7-a0dc-8e5380034a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7701f927-ace7-4310-9a77-d5f9aaaa32ba', 'volume_size': 1, 'image_id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8a9fdfe427f436894d9c81085f9b6d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'created_at': datetime.datetime(2026, 11, 3, 12, 0, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 0, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98eb26ba-81d0-4cb0-9ff1-d965be787864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:44 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Volume volume-7701f927-ace7-4310-9a77-d5f9aaaa32ba (7701f927-ace7-4310-9a77-d5f9aaaa32ba): created successfully Nov 03 13:17:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98eb26ba-81d0-4cb0-9ff1-d965be787864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Flow 'volume_create_manager' (c852aa5b-4e2b-4a01-9311-489bb2292436) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:17:44 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-3526f532-9ae2-401c-a287-6cc6b6affef6 tempest-VolumesExtendTest-746865370 None] Created volume successfully. Nov 03 13:17:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-26cfe0b3-4cd4-41ff-b8ab-becd29c0142d tempest-VolumesExtendTest-746865370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-26cfe0b3-4cd4-41ff-b8ab-becd29c0142d tempest-VolumesExtendTest-746865370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:44 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[9681df65-ca6f-4db0-8d84-99c986a84bb1]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:17:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-26cfe0b3-4cd4-41ff-b8ab-becd29c0142d tempest-VolumesExtendTest-746865370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7701f927-ace7-4310-9a77-d5f9aaaa32ba {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:44 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7701f927-ace7-4310-9a77-d5f9aaaa32ba Nov 03 13:17:44 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:45 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-26cfe0b3-4cd4-41ff-b8ab-becd29c0142d tempest-VolumesExtendTest-746865370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7701f927-ace7-4310-9a77-d5f9aaaa32ba" returned: 0 in 0.440s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-26cfe0b3-4cd4-41ff-b8ab-becd29c0142d tempest-VolumesExtendTest-746865370 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7701f927-ace7-4310-9a77-d5f9aaaa32ba 2G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-26cfe0b3-4cd4-41ff-b8ab-becd29c0142d tempest-VolumesExtendTest-746865370 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7701f927-ace7-4310-9a77-d5f9aaaa32ba 2G" returned: 0 in 0.103s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-26cfe0b3-4cd4-41ff-b8ab-becd29c0142d tempest-VolumesExtendTest-746865370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.576s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:45 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-26cfe0b3-4cd4-41ff-b8ab-becd29c0142d tempest-VolumesExtendTest-746865370 None] Extend volume completed successfully. Nov 03 13:17:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d82d39dd-8793-47a0-945c-2e649a51d6e9 tempest-VolumesExtendTest-746865370 None] Acquiring lock "cinder-7701f927-ace7-4310-9a77-d5f9aaaa32ba-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:17:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d82d39dd-8793-47a0-945c-2e649a51d6e9 tempest-VolumesExtendTest-746865370 None] Lock "cinder-7701f927-ace7-4310-9a77-d5f9aaaa32ba-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:17:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d82d39dd-8793-47a0-945c-2e649a51d6e9 tempest-VolumesExtendTest-746865370 None] Acquiring lock "cinder-quobyte-7701f927-ace7-4310-9a77-d5f9aaaa32ba" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:17:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d82d39dd-8793-47a0-945c-2e649a51d6e9 tempest-VolumesExtendTest-746865370 None] Lock "cinder-quobyte-7701f927-ace7-4310-9a77-d5f9aaaa32ba" acquired by "delete_volume" :: waited 0.014s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:17:46 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af72c25-e196-41e7-a6f6-0db1873d4146]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:17:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d82d39dd-8793-47a0-945c-2e649a51d6e9 tempest-VolumesExtendTest-746865370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7701f927-ace7-4310-9a77-d5f9aaaa32ba {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:46 devstack sudo[99490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7701f927-ace7-4310-9a77-d5f9aaaa32ba Nov 03 13:17:46 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:17:47 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] Flow 'volume_create_manager' (32bf36ea-eb11-4e47-85be-d82b116a0d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f691a5d-fa08-4919-9b3d-e06f4727351c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d82d39dd-8793-47a0-945c-2e649a51d6e9 tempest-VolumesExtendTest-746865370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7701f927-ace7-4310-9a77-d5f9aaaa32ba" returned: 0 in 0.667s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d82d39dd-8793-47a0-945c-2e649a51d6e9 tempest-VolumesExtendTest-746865370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7701f927-ace7-4310-9a77-d5f9aaaa32ba {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f691a5d-fa08-4919-9b3d-e06f4727351c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf8291d-2216-4d43-be20-ebd2cd343316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cdffd3a5bdb42c4bab00c5660e59ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:17:47Z,use_quota=True,user_id='258878bdd1b04810abdca4f14e388b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:47 devstack sudo[99517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7701f927-ace7-4310-9a77-d5f9aaaa32ba Nov 03 13:17:47 devstack sudo[99517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bd54664-b379-4e52-90d0-d31e08833819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bd54664-b379-4e52-90d0-d31e08833819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b462aa7-2963-47ff-8180-4931ea9dee3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b462aa7-2963-47ff-8180-4931ea9dee3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bf8291d-2216-4d43-be20-ebd2cd343316', 'volume_name': 'volume-2bf8291d-2216-4d43-be20-ebd2cd343316', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf5697ac-fe58-4f37-b443-d38275fa04f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf5697ac-fe58-4f37-b443-d38275fa04f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a67ee573-dda3-4d55-ab80-4e79decf92d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:47 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] Volume 2bf8291d-2216-4d43-be20-ebd2cd343316: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bf8291d-2216-4d43-be20-ebd2cd343316', 'volume_size': 1} Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf8291d-2216-4d43-be20-ebd2cd343316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cdffd3a5bdb42c4bab00c5660e59ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:17:47Z,use_quota=True,user_id='258878bdd1b04810abdca4f14e388b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] Creating volume 2bf8291d-2216-4d43-be20-ebd2cd343316 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:17:47 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2bf8291d-2216-4d43-be20-ebd2cd343316 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:47 devstack sudo[99520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2bf8291d-2216-4d43-be20-ebd2cd343316 1073741824 Nov 03 13:17:47 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:47 devstack sudo[99517]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d82d39dd-8793-47a0-945c-2e649a51d6e9 tempest-VolumesExtendTest-746865370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7701f927-ace7-4310-9a77-d5f9aaaa32ba" returned: 0 in 0.305s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d82d39dd-8793-47a0-945c-2e649a51d6e9 tempest-VolumesExtendTest-746865370 None] Lock "cinder-quobyte-7701f927-ace7-4310-9a77-d5f9aaaa32ba" released by "delete_volume" :: held 1.040s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-d82d39dd-8793-47a0-945c-2e649a51d6e9 tempest-VolumesExtendTest-746865370 None] Created reservations ['17d76eb2-ffae-4b3d-bf56-cbd04f96c34f', '123c2dea-2ed8-4a89-9eac-3648d65a6267', '8a77edde-f6f5-4b20-b9b3-6fab14759cb9', 'ef55ee02-51c0-4792-8089-3c574f1d6f94'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d82d39dd-8793-47a0-945c-2e649a51d6e9 tempest-VolumesExtendTest-746865370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d82d39dd-8793-47a0-945c-2e649a51d6e9 tempest-VolumesExtendTest-746865370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d82d39dd-8793-47a0-945c-2e649a51d6e9 tempest-VolumesExtendTest-746865370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d82d39dd-8793-47a0-945c-2e649a51d6e9 tempest-VolumesExtendTest-746865370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d82d39dd-8793-47a0-945c-2e649a51d6e9 tempest-VolumesExtendTest-746865370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d82d39dd-8793-47a0-945c-2e649a51d6e9 tempest-VolumesExtendTest-746865370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:47 devstack sudo[99527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:17:47 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:47 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2bf8291d-2216-4d43-be20-ebd2cd343316 1073741824" returned: 0 in 0.644s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2bf8291d-2216-4d43-be20-ebd2cd343316 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:47 devstack sudo[99529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2bf8291d-2216-4d43-be20-ebd2cd343316 Nov 03 13:17:47 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:48 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d82d39dd-8793-47a0-945c-2e649a51d6e9 tempest-VolumesExtendTest-746865370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.339s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:48 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-d82d39dd-8793-47a0-945c-2e649a51d6e9 tempest-VolumesExtendTest-746865370 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:17:48 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-d82d39dd-8793-47a0-945c-2e649a51d6e9 tempest-VolumesExtendTest-746865370 None] Deleted volume successfully. Nov 03 13:17:48 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d82d39dd-8793-47a0-945c-2e649a51d6e9 tempest-VolumesExtendTest-746865370 None] Lock "cinder-7701f927-ace7-4310-9a77-d5f9aaaa32ba-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:17:48 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2bf8291d-2216-4d43-be20-ebd2cd343316" returned: 0 in 0.359s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:48 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:17:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:48 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a67ee573-dda3-4d55-ab80-4e79decf92d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bf8291d-2216-4d43-be20-ebd2cd343316', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:48 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a410db91-1c79-4ca2-a308-ea6b640a921f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:48 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] Volume volume-2bf8291d-2216-4d43-be20-ebd2cd343316 (2bf8291d-2216-4d43-be20-ebd2cd343316): created successfully Nov 03 13:17:48 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a410db91-1c79-4ca2-a308-ea6b640a921f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:48 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] Flow 'volume_create_manager' (32bf36ea-eb11-4e47-85be-d82b116a0d7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:17:48 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-ede0e669-60fa-4377-af02-fe1fe4465fb3 tempest-CinderUnicodeTest-1283704199 None] Created volume successfully. Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:UPDATE=115,cinder:SELECT=103,cinder:INSERT=25,cinder:DELETE=8 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=107,cinder:INSERT=38,cinder:UPDATE=125,cinder:DELETE=9 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] Flow 'volume_create_manager' (9cf4d532-8165-4842-b5e3-96fbd65505f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bbd26f8-7d6c-475d-9c8e-e2bb9e904e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bbd26f8-7d6c-475d-9c8e-e2bb9e904e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-833141762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a8c946-7351-4087-8011-0b4cd3839ed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d1df72fba2f4bc58f58f52016962938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:17:49Z,use_quota=True,user_id='8fc2c179388343058721a48edc966e5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da2f0f0-fced-4019-bd55-65e84fb99202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da2f0f0-fced-4019-bd55-65e84fb99202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6057ce7b-6845-46ce-9ad7-423a7e9d439e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6057ce7b-6845-46ce-9ad7-423a7e9d439e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85a8c946-7351-4087-8011-0b4cd3839ed3', 'volume_name': 'volume-85a8c946-7351-4087-8011-0b4cd3839ed3', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe5c0491-4979-4c89-87bb-663a80a038bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe5c0491-4979-4c89-87bb-663a80a038bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1892e386-d14b-441e-a74a-426de1f364b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:49 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] Volume 85a8c946-7351-4087-8011-0b4cd3839ed3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85a8c946-7351-4087-8011-0b4cd3839ed3', 'volume_size': 1} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-833141762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a8c946-7351-4087-8011-0b4cd3839ed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d1df72fba2f4bc58f58f52016962938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:17:49Z,use_quota=True,user_id='8fc2c179388343058721a48edc966e5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] Creating volume 85a8c946-7351-4087-8011-0b4cd3839ed3 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:17:49 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-85a8c946-7351-4087-8011-0b4cd3839ed3 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:49 devstack sudo[99539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-85a8c946-7351-4087-8011-0b4cd3839ed3 1073741824 Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:17:49 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] Flow 'volume_create_manager' (9e99af5e-fe79-45b9-821f-d680f77ed03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab31445c-a977-49a2-a569-6b0e1b56620d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab31445c-a977-49a2-a569-6b0e1b56620d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-90247604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5351716b-9346-4332-993c-a019603d15ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbfe907704b34e61aab2f8fb9e66c4b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:17:49Z,use_quota=True,user_id='9fe0e64314e54e649d06c0354c40e79a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e68e735-0bc1-48c4-b833-f4dd5de5923c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e68e735-0bc1-48c4-b833-f4dd5de5923c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f69e0618-548b-4a16-b6ec-1c21b20e5f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f69e0618-548b-4a16-b6ec-1c21b20e5f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5351716b-9346-4332-993c-a019603d15ee', 'volume_name': 'volume-5351716b-9346-4332-993c-a019603d15ee', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7a0e2a2-2b64-4b54-8d68-9949bec97486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7a0e2a2-2b64-4b54-8d68-9949bec97486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (895e4596-8047-4245-8a03-6f11c4323189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:49 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] Volume 5351716b-9346-4332-993c-a019603d15ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5351716b-9346-4332-993c-a019603d15ee', 'volume_size': 1} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] Flow 'volume_create_manager' (4179b473-e3db-431b-8f1c-dd53ae3e98ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e88fae-cd60-4653-bf80-3540f1a5deca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e88fae-cd60-4653-bf80-3540f1a5deca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:17:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1966755695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23081f60-3aa5-4457-b9cf-860baf021140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cdffd3a5bdb42c4bab00c5660e59ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:17:50Z,use_quota=True,user_id='258878bdd1b04810abdca4f14e388b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e065809-d4a5-4801-81f2-b236e2258694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e065809-d4a5-4801-81f2-b236e2258694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a87300fd-5462-4f0c-93eb-8553ca28f480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a87300fd-5462-4f0c-93eb-8553ca28f480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23081f60-3aa5-4457-b9cf-860baf021140', 'volume_name': 'volume-23081f60-3aa5-4457-b9cf-860baf021140', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d77625f-2e1a-41f2-ac8f-93927c253fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d77625f-2e1a-41f2-ac8f-93927c253fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d4ef7f-3529-48c9-878c-d867fb5424ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:49 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] Volume 23081f60-3aa5-4457-b9cf-860baf021140: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23081f60-3aa5-4457-b9cf-860baf021140', 'volume_size': 1} Nov 03 13:17:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:50 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-85a8c946-7351-4087-8011-0b4cd3839ed3 1073741824" returned: 0 in 0.687s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-85a8c946-7351-4087-8011-0b4cd3839ed3 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:50 devstack sudo[99545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-85a8c946-7351-4087-8011-0b4cd3839ed3 Nov 03 13:17:50 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:50 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-85a8c946-7351-4087-8011-0b4cd3839ed3" returned: 0 in 0.254s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:17:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.739s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-90247604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5351716b-9346-4332-993c-a019603d15ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbfe907704b34e61aab2f8fb9e66c4b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:17:49Z,use_quota=True,user_id='9fe0e64314e54e649d06c0354c40e79a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:17:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] Creating volume 5351716b-9346-4332-993c-a019603d15ee {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:17:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:17:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:17:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:17:50 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:17:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1892e386-d14b-441e-a74a-426de1f364b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85a8c946-7351-4087-8011-0b4cd3839ed3', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:50 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee 1073741824 Nov 03 13:17:50 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42d8df80-a875-48f0-9681-d2c32e3dfa6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:50 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] Volume volume-85a8c946-7351-4087-8011-0b4cd3839ed3 (85a8c946-7351-4087-8011-0b4cd3839ed3): created successfully Nov 03 13:17:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42d8df80-a875-48f0-9681-d2c32e3dfa6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] Flow 'volume_create_manager' (9cf4d532-8165-4842-b5e3-96fbd65505f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:17:50 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-96e5209d-b4e6-4884-82d6-c0c21e73adf4 tempest-VolumeQuotasNegativeTestJSON-769973393 None] Created volume successfully. Nov 03 13:17:50 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee 1073741824" returned: 0 in 0.475s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:51 devstack sudo[99554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee Nov 03 13:17:51 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:51 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee" returned: 0 in 0.264s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:17:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.303s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:17:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1966755695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23081f60-3aa5-4457-b9cf-860baf021140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cdffd3a5bdb42c4bab00c5660e59ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:17:50Z,use_quota=True,user_id='258878bdd1b04810abdca4f14e388b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:17:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] Creating volume 23081f60-3aa5-4457-b9cf-860baf021140 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:17:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:17:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:17:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:17:51 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:17:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (895e4596-8047-4245-8a03-6f11c4323189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5351716b-9346-4332-993c-a019603d15ee', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:51 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140 1073741824 Nov 03 13:17:51 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fc756c6-ea21-4ab6-b0ec-e961f37052fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:51 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] Volume volume-5351716b-9346-4332-993c-a019603d15ee (5351716b-9346-4332-993c-a019603d15ee): created successfully Nov 03 13:17:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fc756c6-ea21-4ab6-b0ec-e961f37052fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] Flow 'volume_create_manager' (9e99af5e-fe79-45b9-821f-d680f77ed03e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:17:51 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-1de3d1c4-2010-4e76-bbf8-6541207c7c80 tempest-VolumesExtendTest-746865370 None] Created volume successfully. Nov 03 13:17:51 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140 1073741824" returned: 0 in 0.448s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:51 devstack sudo[99563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140 Nov 03 13:17:51 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:52 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140" returned: 0 in 0.293s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:52 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:17:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d4ef7f-3529-48c9-878c-d867fb5424ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23081f60-3aa5-4457-b9cf-860baf021140', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e97a7e5-195a-4119-b99b-73b414b5c1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:17:52 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] Volume volume-23081f60-3aa5-4457-b9cf-860baf021140 (23081f60-3aa5-4457-b9cf-860baf021140): created successfully Nov 03 13:17:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e97a7e5-195a-4119-b99b-73b414b5c1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:17:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] Flow 'volume_create_manager' (4179b473-e3db-431b-8f1c-dd53ae3e98ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:17:52 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-8db464e1-ca96-439d-9e45-f3da448d4fe6 tempest-CinderUnicodeTest-1283704199 None] Created volume successfully. Nov 03 13:17:52 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-17487878-3e20-4b59-bcdd-7297b971518b tempest-VolumeQuotasNegativeTestJSON-769973393 None] Acquiring lock "cinder-85a8c946-7351-4087-8011-0b4cd3839ed3-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:17:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9e3061a8-2406-4c2f-8ebc-bdc649043000 tempest-VolumesExtendTest-746865370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9e3061a8-2406-4c2f-8ebc-bdc649043000 tempest-VolumesExtendTest-746865370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:52 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-17487878-3e20-4b59-bcdd-7297b971518b tempest-VolumeQuotasNegativeTestJSON-769973393 None] Lock "cinder-85a8c946-7351-4087-8011-0b4cd3839ed3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:17:52 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-9e3061a8-2406-4c2f-8ebc-bdc649043000 tempest-VolumesExtendTest-746865370 None] Creating offline snapshot c37e8d35-9f6b-4664-bae0-1279adad18de of volume 5351716b-9346-4332-993c-a019603d15ee {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:17:52 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6dc9b1-71c1-4cff-9cc3-fb8544148efd]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:17:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9e3061a8-2406-4c2f-8ebc-bdc649043000 tempest-VolumesExtendTest-746865370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:52 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-17487878-3e20-4b59-bcdd-7297b971518b tempest-VolumeQuotasNegativeTestJSON-769973393 None] Acquiring lock "cinder-quobyte-85a8c946-7351-4087-8011-0b4cd3839ed3" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:17:52 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-17487878-3e20-4b59-bcdd-7297b971518b tempest-VolumeQuotasNegativeTestJSON-769973393 None] Lock "cinder-quobyte-85a8c946-7351-4087-8011-0b4cd3839ed3" acquired by "delete_volume" :: waited 0.025s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:17:52 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1a2d07-c330-4b7c-ba39-9eb8f839dd27]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:17:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-17487878-3e20-4b59-bcdd-7297b971518b tempest-VolumeQuotasNegativeTestJSON-769973393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-85a8c946-7351-4087-8011-0b4cd3839ed3 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:52 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee Nov 03 13:17:52 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:52 devstack sudo[99567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-85a8c946-7351-4087-8011-0b4cd3839ed3 Nov 03 13:17:52 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:53 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9e3061a8-2406-4c2f-8ebc-bdc649043000 tempest-VolumesExtendTest-746865370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee" returned: 0 in 0.429s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9e3061a8-2406-4c2f-8ebc-bdc649043000 tempest-VolumesExtendTest-746865370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee.c37e8d35-9f6b-4664-bae0-1279adad18de 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:53 devstack sudo[99577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee.c37e8d35-9f6b-4664-bae0-1279adad18de 1G Nov 03 13:17:53 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:53 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-17487878-3e20-4b59-bcdd-7297b971518b tempest-VolumeQuotasNegativeTestJSON-769973393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-85a8c946-7351-4087-8011-0b4cd3839ed3" returned: 0 in 0.389s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-17487878-3e20-4b59-bcdd-7297b971518b tempest-VolumeQuotasNegativeTestJSON-769973393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-85a8c946-7351-4087-8011-0b4cd3839ed3 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:53 devstack sudo[99579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-85a8c946-7351-4087-8011-0b4cd3839ed3 Nov 03 13:17:53 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:53 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-17487878-3e20-4b59-bcdd-7297b971518b tempest-VolumeQuotasNegativeTestJSON-769973393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-85a8c946-7351-4087-8011-0b4cd3839ed3" returned: 0 in 0.383s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-17487878-3e20-4b59-bcdd-7297b971518b tempest-VolumeQuotasNegativeTestJSON-769973393 None] Lock "cinder-quobyte-85a8c946-7351-4087-8011-0b4cd3839ed3" released by "delete_volume" :: held 0.856s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:17:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-94134f77-0101-4181-85ff-c711a445354b tempest-CinderUnicodeTest-1283704199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:53 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9e3061a8-2406-4c2f-8ebc-bdc649043000 tempest-VolumesExtendTest-746865370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee.c37e8d35-9f6b-4664-bae0-1279adad18de 1G" returned: 0 in 0.571s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9e3061a8-2406-4c2f-8ebc-bdc649043000 tempest-VolumesExtendTest-746865370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5351716b-9346-4332-993c-a019603d15ee -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee.c37e8d35-9f6b-4664-bae0-1279adad18de {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:53 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-17487878-3e20-4b59-bcdd-7297b971518b tempest-VolumeQuotasNegativeTestJSON-769973393 None] Created reservations ['b2b50160-5b3a-44bc-aac1-a98e27c52080', '397cdfc3-a7e7-42dd-9814-50dfadcde708', '27addf4b-2ba5-4b5d-ad00-a14527397859', '59e88554-1637-45a0-a4df-743fc5634ab5'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:17:53 devstack sudo[99586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5351716b-9346-4332-993c-a019603d15ee -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee.c37e8d35-9f6b-4664-bae0-1279adad18de Nov 03 13:17:53 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-17487878-3e20-4b59-bcdd-7297b971518b tempest-VolumeQuotasNegativeTestJSON-769973393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-17487878-3e20-4b59-bcdd-7297b971518b tempest-VolumeQuotasNegativeTestJSON-769973393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:53 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-17487878-3e20-4b59-bcdd-7297b971518b tempest-VolumeQuotasNegativeTestJSON-769973393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:17:53 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-17487878-3e20-4b59-bcdd-7297b971518b tempest-VolumeQuotasNegativeTestJSON-769973393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:17:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-17487878-3e20-4b59-bcdd-7297b971518b tempest-VolumeQuotasNegativeTestJSON-769973393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-17487878-3e20-4b59-bcdd-7297b971518b tempest-VolumeQuotasNegativeTestJSON-769973393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:53 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:17:53 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:53 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9e3061a8-2406-4c2f-8ebc-bdc649043000 tempest-VolumesExtendTest-746865370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5351716b-9346-4332-993c-a019603d15ee -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee.c37e8d35-9f6b-4664-bae0-1279adad18de" returned: 0 in 0.334s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:53 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-9e3061a8-2406-4c2f-8ebc-bdc649043000 tempest-VolumesExtendTest-746865370 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee.c37e8d35-9f6b-4664-bae0-1279adad18de is being set with open permissions: ugo+rw Nov 03 13:17:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9e3061a8-2406-4c2f-8ebc-bdc649043000 tempest-VolumesExtendTest-746865370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee.c37e8d35-9f6b-4664-bae0-1279adad18de {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:53 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee.c37e8d35-9f6b-4664-bae0-1279adad18de Nov 03 13:17:53 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:53 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-17487878-3e20-4b59-bcdd-7297b971518b tempest-VolumeQuotasNegativeTestJSON-769973393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.285s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:54 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-17487878-3e20-4b59-bcdd-7297b971518b tempest-VolumeQuotasNegativeTestJSON-769973393 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:17:54 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-17487878-3e20-4b59-bcdd-7297b971518b tempest-VolumeQuotasNegativeTestJSON-769973393 None] Deleted volume successfully. Nov 03 13:17:54 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-17487878-3e20-4b59-bcdd-7297b971518b tempest-VolumeQuotasNegativeTestJSON-769973393 None] Lock "cinder-85a8c946-7351-4087-8011-0b4cd3839ed3-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:17:54 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9e3061a8-2406-4c2f-8ebc-bdc649043000 tempest-VolumesExtendTest-746865370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee.c37e8d35-9f6b-4664-bae0-1279adad18de" returned: 0 in 0.256s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9e3061a8-2406-4c2f-8ebc-bdc649043000 tempest-VolumesExtendTest-746865370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:54 devstack sudo[99597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee.info Nov 03 13:17:54 devstack sudo[99597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:54 devstack sudo[99597]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9e3061a8-2406-4c2f-8ebc-bdc649043000 tempest-VolumesExtendTest-746865370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee.info" returned: 0 in 0.265s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:54 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-9e3061a8-2406-4c2f-8ebc-bdc649043000 tempest-VolumesExtendTest-746865370 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee.info is being set with open permissions: ugo+rw Nov 03 13:17:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9e3061a8-2406-4c2f-8ebc-bdc649043000 tempest-VolumesExtendTest-746865370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:54 devstack sudo[99600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee.info Nov 03 13:17:54 devstack sudo[99600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:54 devstack sudo[99600]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9e3061a8-2406-4c2f-8ebc-bdc649043000 tempest-VolumesExtendTest-746865370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee.info" returned: 0 in 0.267s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9e3061a8-2406-4c2f-8ebc-bdc649043000 tempest-VolumesExtendTest-746865370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.240s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-94134f77-0101-4181-85ff-c711a445354b tempest-CinderUnicodeTest-1283704199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.201s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:54 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-94134f77-0101-4181-85ff-c711a445354b tempest-CinderUnicodeTest-1283704199 None] Creating offline snapshot 963e1cf8-5bbe-4a8f-885c-72531e80fa59 of volume 23081f60-3aa5-4457-b9cf-860baf021140 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:17:54 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-9e3061a8-2406-4c2f-8ebc-bdc649043000 tempest-VolumesExtendTest-746865370 None] Create snapshot completed successfully Nov 03 13:17:54 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[638ce661-f4c7-4328-a39e-d4e1b6eff476]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:17:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-94134f77-0101-4181-85ff-c711a445354b tempest-CinderUnicodeTest-1283704199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:54 devstack sudo[99603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140 Nov 03 13:17:54 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:55 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-94134f77-0101-4181-85ff-c711a445354b tempest-CinderUnicodeTest-1283704199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140" returned: 0 in 0.409s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-94134f77-0101-4181-85ff-c711a445354b tempest-CinderUnicodeTest-1283704199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140.963e1cf8-5bbe-4a8f-885c-72531e80fa59 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:55 devstack sudo[99608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140.963e1cf8-5bbe-4a8f-885c-72531e80fa59 1G Nov 03 13:17:55 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:55 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-94134f77-0101-4181-85ff-c711a445354b tempest-CinderUnicodeTest-1283704199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140.963e1cf8-5bbe-4a8f-885c-72531e80fa59 1G" returned: 0 in 0.508s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-94134f77-0101-4181-85ff-c711a445354b tempest-CinderUnicodeTest-1283704199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23081f60-3aa5-4457-b9cf-860baf021140 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140.963e1cf8-5bbe-4a8f-885c-72531e80fa59 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:55 devstack sudo[99621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23081f60-3aa5-4457-b9cf-860baf021140 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140.963e1cf8-5bbe-4a8f-885c-72531e80fa59 Nov 03 13:17:55 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-807b2ef8-1356-4e5a-85a8-7e0a3af16fe8 tempest-VolumesExtendTest-746865370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:56 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-94134f77-0101-4181-85ff-c711a445354b tempest-CinderUnicodeTest-1283704199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23081f60-3aa5-4457-b9cf-860baf021140 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140.963e1cf8-5bbe-4a8f-885c-72531e80fa59" returned: 0 in 0.370s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:56 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-94134f77-0101-4181-85ff-c711a445354b tempest-CinderUnicodeTest-1283704199 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140.963e1cf8-5bbe-4a8f-885c-72531e80fa59 is being set with open permissions: ugo+rw Nov 03 13:17:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-94134f77-0101-4181-85ff-c711a445354b tempest-CinderUnicodeTest-1283704199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140.963e1cf8-5bbe-4a8f-885c-72531e80fa59 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:56 devstack sudo[99626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140.963e1cf8-5bbe-4a8f-885c-72531e80fa59 Nov 03 13:17:56 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:56 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-94134f77-0101-4181-85ff-c711a445354b tempest-CinderUnicodeTest-1283704199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140.963e1cf8-5bbe-4a8f-885c-72531e80fa59" returned: 0 in 0.288s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-94134f77-0101-4181-85ff-c711a445354b tempest-CinderUnicodeTest-1283704199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:56 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140.info Nov 03 13:17:56 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:56 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-94134f77-0101-4181-85ff-c711a445354b tempest-CinderUnicodeTest-1283704199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140.info" returned: 0 in 0.338s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:56 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-94134f77-0101-4181-85ff-c711a445354b tempest-CinderUnicodeTest-1283704199 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140.info is being set with open permissions: ugo+rw Nov 03 13:17:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-94134f77-0101-4181-85ff-c711a445354b tempest-CinderUnicodeTest-1283704199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:56 devstack sudo[99633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140.info Nov 03 13:17:56 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:57 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-94134f77-0101-4181-85ff-c711a445354b tempest-CinderUnicodeTest-1283704199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140.info" returned: 0 in 0.320s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-94134f77-0101-4181-85ff-c711a445354b tempest-CinderUnicodeTest-1283704199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.355s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-807b2ef8-1356-4e5a-85a8-7e0a3af16fe8 tempest-VolumesExtendTest-746865370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.297s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:57 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[908f8a89-ee9a-4238-9d12-8c45146eb77f]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:17:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-807b2ef8-1356-4e5a-85a8-7e0a3af16fe8 tempest-VolumesExtendTest-746865370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:57 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-94134f77-0101-4181-85ff-c711a445354b tempest-CinderUnicodeTest-1283704199 None] Create snapshot completed successfully Nov 03 13:17:57 devstack sudo[99636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee Nov 03 13:17:57 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:57 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-807b2ef8-1356-4e5a-85a8-7e0a3af16fe8 tempest-VolumesExtendTest-746865370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee" returned: 0 in 0.447s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-807b2ef8-1356-4e5a-85a8-7e0a3af16fe8 tempest-VolumesExtendTest-746865370 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee.c37e8d35-9f6b-4664-bae0-1279adad18de 2G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-807b2ef8-1356-4e5a-85a8-7e0a3af16fe8 tempest-VolumesExtendTest-746865370 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee.c37e8d35-9f6b-4664-bae0-1279adad18de 2G" returned: 0 in 0.170s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-807b2ef8-1356-4e5a-85a8-7e0a3af16fe8 tempest-VolumesExtendTest-746865370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.667s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:57 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9013db79-e0a1-47e6-a443-701f9cf4f3d7 tempest-CinderUnicodeTest-1283704199 None] Acquiring lock "cinder-963e1cf8-5bbe-4a8f-885c-72531e80fa59-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:17:57 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9013db79-e0a1-47e6-a443-701f9cf4f3d7 tempest-CinderUnicodeTest-1283704199 None] Lock "cinder-963e1cf8-5bbe-4a8f-885c-72531e80fa59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:17:57 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9013db79-e0a1-47e6-a443-701f9cf4f3d7 tempest-CinderUnicodeTest-1283704199 None] Acquiring lock "cinder-quobyte-23081f60-3aa5-4457-b9cf-860baf021140" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:17:57 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-807b2ef8-1356-4e5a-85a8-7e0a3af16fe8 tempest-VolumesExtendTest-746865370 None] Extend volume completed successfully. Nov 03 13:17:57 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9013db79-e0a1-47e6-a443-701f9cf4f3d7 tempest-CinderUnicodeTest-1283704199 None] Lock "cinder-quobyte-23081f60-3aa5-4457-b9cf-860baf021140" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:17:57 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9013db79-e0a1-47e6-a443-701f9cf4f3d7 tempest-CinderUnicodeTest-1283704199 None] Acquiring lock "cinder-quobyte-963e1cf8-5bbe-4a8f-885c-72531e80fa59" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:17:57 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9013db79-e0a1-47e6-a443-701f9cf4f3d7 tempest-CinderUnicodeTest-1283704199 None] Lock "cinder-quobyte-963e1cf8-5bbe-4a8f-885c-72531e80fa59" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:17:57 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-9013db79-e0a1-47e6-a443-701f9cf4f3d7 tempest-CinderUnicodeTest-1283704199 None] Deleting offline snapshot 963e1cf8-5bbe-4a8f-885c-72531e80fa59 of volume 23081f60-3aa5-4457-b9cf-860baf021140 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:17:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-9013db79-e0a1-47e6-a443-701f9cf4f3d7 tempest-CinderUnicodeTest-1283704199 None] snapshot_file for this snap is: volume-23081f60-3aa5-4457-b9cf-860baf021140.963e1cf8-5bbe-4a8f-885c-72531e80fa59 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:17:58 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4fa611-6b3b-46f8-bd6b-45b9ae906b7d]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:17:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9013db79-e0a1-47e6-a443-701f9cf4f3d7 tempest-CinderUnicodeTest-1283704199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140.963e1cf8-5bbe-4a8f-885c-72531e80fa59 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:58 devstack sudo[99644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140.963e1cf8-5bbe-4a8f-885c-72531e80fa59 Nov 03 13:17:58 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:58 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-891f7f2f-5038-4976-9f45-7a23cdc8d1d8 tempest-VolumesExtendTest-746865370 None] Acquiring lock "cinder-c37e8d35-9f6b-4664-bae0-1279adad18de-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:17:58 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-891f7f2f-5038-4976-9f45-7a23cdc8d1d8 tempest-VolumesExtendTest-746865370 None] Lock "cinder-c37e8d35-9f6b-4664-bae0-1279adad18de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:17:58 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-891f7f2f-5038-4976-9f45-7a23cdc8d1d8 tempest-VolumesExtendTest-746865370 None] Acquiring lock "cinder-quobyte-5351716b-9346-4332-993c-a019603d15ee" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:17:58 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-891f7f2f-5038-4976-9f45-7a23cdc8d1d8 tempest-VolumesExtendTest-746865370 None] Lock "cinder-quobyte-5351716b-9346-4332-993c-a019603d15ee" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:17:58 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-891f7f2f-5038-4976-9f45-7a23cdc8d1d8 tempest-VolumesExtendTest-746865370 None] Acquiring lock "cinder-quobyte-c37e8d35-9f6b-4664-bae0-1279adad18de" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:17:58 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-891f7f2f-5038-4976-9f45-7a23cdc8d1d8 tempest-VolumesExtendTest-746865370 None] Lock "cinder-quobyte-c37e8d35-9f6b-4664-bae0-1279adad18de" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:17:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-891f7f2f-5038-4976-9f45-7a23cdc8d1d8 tempest-VolumesExtendTest-746865370 None] Deleting offline snapshot c37e8d35-9f6b-4664-bae0-1279adad18de of volume 5351716b-9346-4332-993c-a019603d15ee {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:17:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-891f7f2f-5038-4976-9f45-7a23cdc8d1d8 tempest-VolumesExtendTest-746865370 None] snapshot_file for this snap is: volume-5351716b-9346-4332-993c-a019603d15ee.c37e8d35-9f6b-4664-bae0-1279adad18de {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:17:58 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bf3b41-864e-4c1a-9e5f-91f37dd4906d]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:17:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-891f7f2f-5038-4976-9f45-7a23cdc8d1d8 tempest-VolumesExtendTest-746865370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee.c37e8d35-9f6b-4664-bae0-1279adad18de {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:58 devstack sudo[99646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee.c37e8d35-9f6b-4664-bae0-1279adad18de Nov 03 13:17:58 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:58 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9013db79-e0a1-47e6-a443-701f9cf4f3d7 tempest-CinderUnicodeTest-1283704199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140.963e1cf8-5bbe-4a8f-885c-72531e80fa59" returned: 0 in 0.578s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-9013db79-e0a1-47e6-a443-701f9cf4f3d7 tempest-CinderUnicodeTest-1283704199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23081f60-3aa5-4457-b9cf-860baf021140(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:17:58 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00f284c-41d8-4520-82d5-325deeade0d7]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:17:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9013db79-e0a1-47e6-a443-701f9cf4f3d7 tempest-CinderUnicodeTest-1283704199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:58 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:17:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:17:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:17:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:17:58 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140 Nov 03 13:17:58 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:17:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:17:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:58 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:17:58 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:58 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-891f7f2f-5038-4976-9f45-7a23cdc8d1d8 tempest-VolumesExtendTest-746865370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee.c37e8d35-9f6b-4664-bae0-1279adad18de" returned: 0 in 0.502s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-891f7f2f-5038-4976-9f45-7a23cdc8d1d8 tempest-VolumesExtendTest-746865370 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5351716b-9346-4332-993c-a019603d15ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:17:58 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3b3285-b799-45a0-8bb4-6af11b86fee5]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:17:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-891f7f2f-5038-4976-9f45-7a23cdc8d1d8 tempest-VolumesExtendTest-746865370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:59 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee Nov 03 13:17:59 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:59 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:59 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.394s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:59 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:17:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9013db79-e0a1-47e6-a443-701f9cf4f3d7 tempest-CinderUnicodeTest-1283704199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140" returned: 0 in 0.555s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9013db79-e0a1-47e6-a443-701f9cf4f3d7 tempest-CinderUnicodeTest-1283704199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140.963e1cf8-5bbe-4a8f-885c-72531e80fa59 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:59 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager._thread_info {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:17:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread count: 28 {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:17:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread info: [<_MainThread(MainThread, started 133507074375808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:17:59 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140.963e1cf8-5bbe-4a8f-885c-72531e80fa59 Nov 03 13:17:59 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:59 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-891f7f2f-5038-4976-9f45-7a23cdc8d1d8 tempest-VolumesExtendTest-746865370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee" returned: 0 in 0.547s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-891f7f2f-5038-4976-9f45-7a23cdc8d1d8 tempest-VolumesExtendTest-746865370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee.c37e8d35-9f6b-4664-bae0-1279adad18de {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:59 devstack sudo[99674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee.c37e8d35-9f6b-4664-bae0-1279adad18de Nov 03 13:17:59 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:59 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9013db79-e0a1-47e6-a443-701f9cf4f3d7 tempest-CinderUnicodeTest-1283704199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140.963e1cf8-5bbe-4a8f-885c-72531e80fa59" returned: 0 in 0.442s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9013db79-e0a1-47e6-a443-701f9cf4f3d7 tempest-CinderUnicodeTest-1283704199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140.963e1cf8-5bbe-4a8f-885c-72531e80fa59 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:59 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140.963e1cf8-5bbe-4a8f-885c-72531e80fa59 Nov 03 13:17:59 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:17:59 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root Nov 03 13:17:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-891f7f2f-5038-4976-9f45-7a23cdc8d1d8 tempest-VolumesExtendTest-746865370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee.c37e8d35-9f6b-4664-bae0-1279adad18de" returned: 0 in 0.423s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:17:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-891f7f2f-5038-4976-9f45-7a23cdc8d1d8 tempest-VolumesExtendTest-746865370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee.c37e8d35-9f6b-4664-bae0-1279adad18de {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:17:59 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9013db79-e0a1-47e6-a443-701f9cf4f3d7 tempest-CinderUnicodeTest-1283704199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140.963e1cf8-5bbe-4a8f-885c-72531e80fa59" returned: 0 in 0.332s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:00 devstack sudo[99683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee.c37e8d35-9f6b-4664-bae0-1279adad18de Nov 03 13:18:00 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9013db79-e0a1-47e6-a443-701f9cf4f3d7 tempest-CinderUnicodeTest-1283704199 None] Lock "cinder-quobyte-963e1cf8-5bbe-4a8f-885c-72531e80fa59" released by "_delete_snapshot" :: held 2.088s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:18:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9013db79-e0a1-47e6-a443-701f9cf4f3d7 tempest-CinderUnicodeTest-1283704199 None] Lock "cinder-quobyte-23081f60-3aa5-4457-b9cf-860baf021140" released by "delete_snapshot" :: held 2.117s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:18:00 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-9013db79-e0a1-47e6-a443-701f9cf4f3d7 tempest-CinderUnicodeTest-1283704199 None] Created reservations ['4ad1d510-58e3-48e6-8029-7be42d4027c8', '878ab0e4-2d45-404e-99d5-16423f4026ac', '79d45c21-142f-4078-bbed-dca912393e41', '04b2875a-7865-441a-b94a-36b64f942ede'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:18:00 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-9013db79-e0a1-47e6-a443-701f9cf4f3d7 tempest-CinderUnicodeTest-1283704199 None] Delete snapshot completed successfully. Nov 03 13:18:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9013db79-e0a1-47e6-a443-701f9cf4f3d7 tempest-CinderUnicodeTest-1283704199 None] Lock "cinder-963e1cf8-5bbe-4a8f-885c-72531e80fa59-delete_snapshot" released by "delete_snapshot" :: held 2.313s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:18:00 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-891f7f2f-5038-4976-9f45-7a23cdc8d1d8 tempest-VolumesExtendTest-746865370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee.c37e8d35-9f6b-4664-bae0-1279adad18de" returned: 0 in 0.334s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-891f7f2f-5038-4976-9f45-7a23cdc8d1d8 tempest-VolumesExtendTest-746865370 None] Lock "cinder-quobyte-c37e8d35-9f6b-4664-bae0-1279adad18de" released by "_delete_snapshot" :: held 1.954s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:18:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-891f7f2f-5038-4976-9f45-7a23cdc8d1d8 tempest-VolumesExtendTest-746865370 None] Lock "cinder-quobyte-5351716b-9346-4332-993c-a019603d15ee" released by "delete_snapshot" :: held 1.981s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:18:00 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-891f7f2f-5038-4976-9f45-7a23cdc8d1d8 tempest-VolumesExtendTest-746865370 None] Created reservations ['b20f95d1-774a-4969-a12c-b3aeefe38bf7', 'fd866bef-e93a-4edc-8616-1bee2d5cdebb', '3a3c6456-a24c-4683-bac0-73fc424f0f6d', 'e2b873e4-e3a4-425e-8190-badbe173fbd2'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:18:00 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-891f7f2f-5038-4976-9f45-7a23cdc8d1d8 tempest-VolumesExtendTest-746865370 None] Delete snapshot completed successfully. Nov 03 13:18:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-891f7f2f-5038-4976-9f45-7a23cdc8d1d8 tempest-VolumesExtendTest-746865370 None] Lock "cinder-c37e8d35-9f6b-4664-bae0-1279adad18de-delete_snapshot" released by "delete_snapshot" :: held 2.188s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:18:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3a458266-9ffc-4491-b9a3-1b75d0c611bd tempest-CinderUnicodeTest-1283704199 None] Acquiring lock "cinder-23081f60-3aa5-4457-b9cf-860baf021140-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:18:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3a458266-9ffc-4491-b9a3-1b75d0c611bd tempest-CinderUnicodeTest-1283704199 None] Lock "cinder-23081f60-3aa5-4457-b9cf-860baf021140-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:18:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3a458266-9ffc-4491-b9a3-1b75d0c611bd tempest-CinderUnicodeTest-1283704199 None] Acquiring lock "cinder-quobyte-23081f60-3aa5-4457-b9cf-860baf021140" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:18:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3a458266-9ffc-4491-b9a3-1b75d0c611bd tempest-CinderUnicodeTest-1283704199 None] Lock "cinder-quobyte-23081f60-3aa5-4457-b9cf-860baf021140" acquired by "delete_volume" :: waited 0.015s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:18:01 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce10fb50-5299-4f40-8736-b099f9f2ba44]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:18:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3a458266-9ffc-4491-b9a3-1b75d0c611bd tempest-CinderUnicodeTest-1283704199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:01 devstack sudo[99700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140 Nov 03 13:18:01 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5e28cb54-0242-4021-9a76-a033c010d96c tempest-VolumesExtendTest-746865370 None] Acquiring lock "cinder-5351716b-9346-4332-993c-a019603d15ee-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:18:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5e28cb54-0242-4021-9a76-a033c010d96c tempest-VolumesExtendTest-746865370 None] Lock "cinder-5351716b-9346-4332-993c-a019603d15ee-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:18:01 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3a458266-9ffc-4491-b9a3-1b75d0c611bd tempest-CinderUnicodeTest-1283704199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140" returned: 0 in 0.400s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3a458266-9ffc-4491-b9a3-1b75d0c611bd tempest-CinderUnicodeTest-1283704199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:01 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140 Nov 03 13:18:01 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5e28cb54-0242-4021-9a76-a033c010d96c tempest-VolumesExtendTest-746865370 None] Acquiring lock "cinder-quobyte-5351716b-9346-4332-993c-a019603d15ee" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:18:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5e28cb54-0242-4021-9a76-a033c010d96c tempest-VolumesExtendTest-746865370 None] Lock "cinder-quobyte-5351716b-9346-4332-993c-a019603d15ee" acquired by "delete_volume" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:18:01 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fd32a5-91d4-4c96-962b-a6bc058bae06]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:18:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5e28cb54-0242-4021-9a76-a033c010d96c tempest-VolumesExtendTest-746865370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:01 devstack sudo[99707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee Nov 03 13:18:01 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:01 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3a458266-9ffc-4491-b9a3-1b75d0c611bd tempest-CinderUnicodeTest-1283704199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23081f60-3aa5-4457-b9cf-860baf021140" returned: 0 in 0.265s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3a458266-9ffc-4491-b9a3-1b75d0c611bd tempest-CinderUnicodeTest-1283704199 None] Lock "cinder-quobyte-23081f60-3aa5-4457-b9cf-860baf021140" released by "delete_volume" :: held 0.742s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:18:02 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-3a458266-9ffc-4491-b9a3-1b75d0c611bd tempest-CinderUnicodeTest-1283704199 None] Created reservations ['ec6d776e-da14-483b-b0ea-ad451e99168b', 'ca19852d-44de-4336-9963-061575b089dd', '150ae62e-96d8-4954-9d45-47f467dcba51', 'e95539a6-9df6-45f3-bb29-0d8aa2aa7cd1'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:18:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3a458266-9ffc-4491-b9a3-1b75d0c611bd tempest-CinderUnicodeTest-1283704199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:18:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3a458266-9ffc-4491-b9a3-1b75d0c611bd tempest-CinderUnicodeTest-1283704199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:18:02 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3a458266-9ffc-4491-b9a3-1b75d0c611bd tempest-CinderUnicodeTest-1283704199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:18:02 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3a458266-9ffc-4491-b9a3-1b75d0c611bd tempest-CinderUnicodeTest-1283704199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:18:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3a458266-9ffc-4491-b9a3-1b75d0c611bd tempest-CinderUnicodeTest-1283704199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:18:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3a458266-9ffc-4491-b9a3-1b75d0c611bd tempest-CinderUnicodeTest-1283704199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:02 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:18:02 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:02 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5e28cb54-0242-4021-9a76-a033c010d96c tempest-VolumesExtendTest-746865370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee" returned: 0 in 0.416s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5e28cb54-0242-4021-9a76-a033c010d96c tempest-VolumesExtendTest-746865370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:02 devstack sudo[99715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee Nov 03 13:18:02 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-6afefc47-76d6-4578-a362-30ce09999721 tempest-CinderUnicodeTest-1283704199 None] Acquiring lock "cinder-2bf8291d-2216-4d43-be20-ebd2cd343316-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:18:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-6afefc47-76d6-4578-a362-30ce09999721 tempest-CinderUnicodeTest-1283704199 None] Lock "cinder-2bf8291d-2216-4d43-be20-ebd2cd343316-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:18:02 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3a458266-9ffc-4491-b9a3-1b75d0c611bd tempest-CinderUnicodeTest-1283704199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.328s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:02 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3a458266-9ffc-4491-b9a3-1b75d0c611bd tempest-CinderUnicodeTest-1283704199 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:18:02 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-3a458266-9ffc-4491-b9a3-1b75d0c611bd tempest-CinderUnicodeTest-1283704199 None] Deleted volume successfully. Nov 03 13:18:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-6afefc47-76d6-4578-a362-30ce09999721 tempest-CinderUnicodeTest-1283704199 None] Acquiring lock "cinder-quobyte-2bf8291d-2216-4d43-be20-ebd2cd343316" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:18:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3a458266-9ffc-4491-b9a3-1b75d0c611bd tempest-CinderUnicodeTest-1283704199 None] Lock "cinder-23081f60-3aa5-4457-b9cf-860baf021140-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:18:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-6afefc47-76d6-4578-a362-30ce09999721 tempest-CinderUnicodeTest-1283704199 None] Lock "cinder-quobyte-2bf8291d-2216-4d43-be20-ebd2cd343316" acquired by "delete_volume" :: waited 0.023s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:18:02 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5e28cb54-0242-4021-9a76-a033c010d96c tempest-VolumesExtendTest-746865370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5351716b-9346-4332-993c-a019603d15ee" returned: 0 in 0.299s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:02 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebb96a5-359e-44b5-a6fa-3c69edbf7f24]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:18:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-6afefc47-76d6-4578-a362-30ce09999721 tempest-CinderUnicodeTest-1283704199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2bf8291d-2216-4d43-be20-ebd2cd343316 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5e28cb54-0242-4021-9a76-a033c010d96c tempest-VolumesExtendTest-746865370 None] Lock "cinder-quobyte-5351716b-9346-4332-993c-a019603d15ee" released by "delete_volume" :: held 0.804s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:18:02 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-5e28cb54-0242-4021-9a76-a033c010d96c tempest-VolumesExtendTest-746865370 None] Created reservations ['7e7174ca-ff25-4096-91e0-5d0f7f21ca7d', '962fe6d2-21d5-4633-bf1f-cd6682522d64', '452e0473-b18c-41fd-85c9-47470a6e089e', 'f31484ab-cfe1-47a8-9da1-a27f14358a52'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:18:02 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2bf8291d-2216-4d43-be20-ebd2cd343316 Nov 03 13:18:02 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5e28cb54-0242-4021-9a76-a033c010d96c tempest-VolumesExtendTest-746865370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:18:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5e28cb54-0242-4021-9a76-a033c010d96c tempest-VolumesExtendTest-746865370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:18:02 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5e28cb54-0242-4021-9a76-a033c010d96c tempest-VolumesExtendTest-746865370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:18:02 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5e28cb54-0242-4021-9a76-a033c010d96c tempest-VolumesExtendTest-746865370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:18:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5e28cb54-0242-4021-9a76-a033c010d96c tempest-VolumesExtendTest-746865370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:18:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5e28cb54-0242-4021-9a76-a033c010d96c tempest-VolumesExtendTest-746865370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:02 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:18:02 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:02 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-6afefc47-76d6-4578-a362-30ce09999721 tempest-CinderUnicodeTest-1283704199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2bf8291d-2216-4d43-be20-ebd2cd343316" returned: 0 in 0.472s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-6afefc47-76d6-4578-a362-30ce09999721 tempest-CinderUnicodeTest-1283704199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2bf8291d-2216-4d43-be20-ebd2cd343316 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:03 devstack sudo[99728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2bf8291d-2216-4d43-be20-ebd2cd343316 Nov 03 13:18:03 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:03 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5e28cb54-0242-4021-9a76-a033c010d96c tempest-VolumesExtendTest-746865370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.343s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:03 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-5e28cb54-0242-4021-9a76-a033c010d96c tempest-VolumesExtendTest-746865370 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:18:03 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-5e28cb54-0242-4021-9a76-a033c010d96c tempest-VolumesExtendTest-746865370 None] Deleted volume successfully. Nov 03 13:18:03 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5e28cb54-0242-4021-9a76-a033c010d96c tempest-VolumesExtendTest-746865370 None] Lock "cinder-5351716b-9346-4332-993c-a019603d15ee-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:18:03 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-6afefc47-76d6-4578-a362-30ce09999721 tempest-CinderUnicodeTest-1283704199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2bf8291d-2216-4d43-be20-ebd2cd343316" returned: 0 in 0.286s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:03 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-6afefc47-76d6-4578-a362-30ce09999721 tempest-CinderUnicodeTest-1283704199 None] Lock "cinder-quobyte-2bf8291d-2216-4d43-be20-ebd2cd343316" released by "delete_volume" :: held 0.819s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:18:03 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-6afefc47-76d6-4578-a362-30ce09999721 tempest-CinderUnicodeTest-1283704199 None] Created reservations ['cae0f6c4-6dc1-4e07-bed0-67e29dd65f24', 'a491f012-3a58-4fb2-b947-4f44d3c020a8', 'f0b092be-5fcf-44c3-85eb-38d930fdac0c', '5eb74684-20a8-4ecf-b517-2d02fddd0be2'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:18:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-6afefc47-76d6-4578-a362-30ce09999721 tempest-CinderUnicodeTest-1283704199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:18:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-6afefc47-76d6-4578-a362-30ce09999721 tempest-CinderUnicodeTest-1283704199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:18:03 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-6afefc47-76d6-4578-a362-30ce09999721 tempest-CinderUnicodeTest-1283704199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:18:03 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-6afefc47-76d6-4578-a362-30ce09999721 tempest-CinderUnicodeTest-1283704199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:18:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-6afefc47-76d6-4578-a362-30ce09999721 tempest-CinderUnicodeTest-1283704199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:18:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-6afefc47-76d6-4578-a362-30ce09999721 tempest-CinderUnicodeTest-1283704199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:03 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:18:03 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:03 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-6afefc47-76d6-4578-a362-30ce09999721 tempest-CinderUnicodeTest-1283704199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.297s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:03 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-6afefc47-76d6-4578-a362-30ce09999721 tempest-CinderUnicodeTest-1283704199 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:18:03 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-6afefc47-76d6-4578-a362-30ce09999721 tempest-CinderUnicodeTest-1283704199 None] Deleted volume successfully. Nov 03 13:18:03 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-6afefc47-76d6-4578-a362-30ce09999721 tempest-CinderUnicodeTest-1283704199 None] Lock "cinder-2bf8291d-2216-4d43-be20-ebd2cd343316-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:18:07 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:18:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] Flow 'volume_create_manager' (64ebe0ac-7aca-4b23-9c3c-04ba0c454029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:18:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d60902-629c-4459-835b-41af763ef6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:18:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d60902-629c-4459-835b-41af763ef6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-848896421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b4f5ff8fed84a38a6a36523b75b6507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:18:08Z,use_quota=True,user_id='e3c5a202520540a1b9b7d507afde2a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:18:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a5f45f0-de4b-4ea6-b012-0e1405d6dea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:18:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a5f45f0-de4b-4ea6-b012-0e1405d6dea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:18:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3374a410-166f-4c07-aed7-7236c0fd5da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:18:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3374a410-166f-4c07-aed7-7236c0fd5da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55', 'volume_name': 'volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:18:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (136bf0f7-fe05-463d-b679-efe442847a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:18:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (136bf0f7-fe05-463d-b679-efe442847a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:18:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db6fe256-57e7-465f-a704-7060c2514ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:18:08 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] Volume f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55', 'volume_size': 1} Nov 03 13:18:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:18:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:18:08 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-848896421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b4f5ff8fed84a38a6a36523b75b6507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:18:08Z,use_quota=True,user_id='e3c5a202520540a1b9b7d507afde2a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:18:08 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] Creating volume f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:18:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:18:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:18:08 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:18:08 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:18:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:18:08 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:18:08 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:18:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:08 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55 1073741824 Nov 03 13:18:08 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:08 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55 1073741824" returned: 0 in 0.581s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:08 devstack sudo[99741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55 Nov 03 13:18:08 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:09 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55" returned: 0 in 0.344s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:09 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:18:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:18:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db6fe256-57e7-465f-a704-7060c2514ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:18:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aea4bc85-31d3-4ed4-aa04-46c02f23c6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:18:09 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] Volume volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55 (f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55): created successfully Nov 03 13:18:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aea4bc85-31d3-4ed4-aa04-46c02f23c6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:18:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] Flow 'volume_create_manager' (64ebe0ac-7aca-4b23-9c3c-04ba0c454029) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:18:09 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-b7a2e408-616d-4e85-8a0a-5b4159049702 tempest-VolumesSnapshotListTestJSON-1209810486 None] Created volume successfully. Nov 03 13:18:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a917def1-a16f-4380-8cb5-6098caf1f8f9 tempest-VolumesSnapshotListTestJSON-1209810486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:18:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a917def1-a16f-4380-8cb5-6098caf1f8f9 tempest-VolumesSnapshotListTestJSON-1209810486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:18:10 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-a917def1-a16f-4380-8cb5-6098caf1f8f9 tempest-VolumesSnapshotListTestJSON-1209810486 None] Creating offline snapshot 24da0598-4979-49e5-8a42-8bea3472f599 of volume f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:18:10 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[835b7670-c7dd-4e6a-b967-b93e052b857d]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:18:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a917def1-a16f-4380-8cb5-6098caf1f8f9 tempest-VolumesSnapshotListTestJSON-1209810486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:10 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55 Nov 03 13:18:10 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:10 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a917def1-a16f-4380-8cb5-6098caf1f8f9 tempest-VolumesSnapshotListTestJSON-1209810486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55" returned: 0 in 0.459s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a917def1-a16f-4380-8cb5-6098caf1f8f9 tempest-VolumesSnapshotListTestJSON-1209810486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.24da0598-4979-49e5-8a42-8bea3472f599 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:10 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.24da0598-4979-49e5-8a42-8bea3472f599 1G Nov 03 13:18:10 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:11 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a917def1-a16f-4380-8cb5-6098caf1f8f9 tempest-VolumesSnapshotListTestJSON-1209810486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.24da0598-4979-49e5-8a42-8bea3472f599 1G" returned: 0 in 0.455s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a917def1-a16f-4380-8cb5-6098caf1f8f9 tempest-VolumesSnapshotListTestJSON-1209810486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.24da0598-4979-49e5-8a42-8bea3472f599 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:11 devstack sudo[99754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.24da0598-4979-49e5-8a42-8bea3472f599 Nov 03 13:18:11 devstack sudo[99754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:11 devstack sudo[99754]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a917def1-a16f-4380-8cb5-6098caf1f8f9 tempest-VolumesSnapshotListTestJSON-1209810486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.24da0598-4979-49e5-8a42-8bea3472f599" returned: 0 in 0.350s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:11 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-a917def1-a16f-4380-8cb5-6098caf1f8f9 tempest-VolumesSnapshotListTestJSON-1209810486 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.24da0598-4979-49e5-8a42-8bea3472f599 is being set with open permissions: ugo+rw Nov 03 13:18:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a917def1-a16f-4380-8cb5-6098caf1f8f9 tempest-VolumesSnapshotListTestJSON-1209810486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.24da0598-4979-49e5-8a42-8bea3472f599 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:11 devstack sudo[99759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.24da0598-4979-49e5-8a42-8bea3472f599 Nov 03 13:18:11 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:11 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a917def1-a16f-4380-8cb5-6098caf1f8f9 tempest-VolumesSnapshotListTestJSON-1209810486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.24da0598-4979-49e5-8a42-8bea3472f599" returned: 0 in 0.285s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a917def1-a16f-4380-8cb5-6098caf1f8f9 tempest-VolumesSnapshotListTestJSON-1209810486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:12 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.info Nov 03 13:18:12 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:12 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a917def1-a16f-4380-8cb5-6098caf1f8f9 tempest-VolumesSnapshotListTestJSON-1209810486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.info" returned: 0 in 0.369s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:12 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-a917def1-a16f-4380-8cb5-6098caf1f8f9 tempest-VolumesSnapshotListTestJSON-1209810486 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.info is being set with open permissions: ugo+rw Nov 03 13:18:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a917def1-a16f-4380-8cb5-6098caf1f8f9 tempest-VolumesSnapshotListTestJSON-1209810486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:12 devstack sudo[99769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.info Nov 03 13:18:12 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:12 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a917def1-a16f-4380-8cb5-6098caf1f8f9 tempest-VolumesSnapshotListTestJSON-1209810486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.info" returned: 0 in 0.289s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a917def1-a16f-4380-8cb5-6098caf1f8f9 tempest-VolumesSnapshotListTestJSON-1209810486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.336s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:18:12 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-a917def1-a16f-4380-8cb5-6098caf1f8f9 tempest-VolumesSnapshotListTestJSON-1209810486 None] Create snapshot completed successfully Nov 03 13:18:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f16d8aff-f65a-40a4-97c7-7160f09a44a6 tempest-VolumesSnapshotListTestJSON-1209810486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:18:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f16d8aff-f65a-40a4-97c7-7160f09a44a6 tempest-VolumesSnapshotListTestJSON-1209810486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:18:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-f16d8aff-f65a-40a4-97c7-7160f09a44a6 tempest-VolumesSnapshotListTestJSON-1209810486 None] Creating offline snapshot 7c03f5bc-3b05-4c77-bd24-139e326dad07 of volume f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:18:13 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dce553-5559-448b-85cf-040cd150f12d]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:18:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f16d8aff-f65a-40a4-97c7-7160f09a44a6 tempest-VolumesSnapshotListTestJSON-1209810486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.24da0598-4979-49e5-8a42-8bea3472f599 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:14 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.24da0598-4979-49e5-8a42-8bea3472f599 Nov 03 13:18:14 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:14 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f16d8aff-f65a-40a4-97c7-7160f09a44a6 tempest-VolumesSnapshotListTestJSON-1209810486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.24da0598-4979-49e5-8a42-8bea3472f599" returned: 0 in 0.524s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:14 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-f16d8aff-f65a-40a4-97c7-7160f09a44a6 tempest-VolumesSnapshotListTestJSON-1209810486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:18:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f16d8aff-f65a-40a4-97c7-7160f09a44a6 tempest-VolumesSnapshotListTestJSON-1209810486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.24da0598-4979-49e5-8a42-8bea3472f599,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.7c03f5bc-3b05-4c77-bd24-139e326dad07 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:14 devstack sudo[99778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.24da0598-4979-49e5-8a42-8bea3472f599,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.7c03f5bc-3b05-4c77-bd24-139e326dad07 1G Nov 03 13:18:14 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:15 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f16d8aff-f65a-40a4-97c7-7160f09a44a6 tempest-VolumesSnapshotListTestJSON-1209810486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.24da0598-4979-49e5-8a42-8bea3472f599,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.7c03f5bc-3b05-4c77-bd24-139e326dad07 1G" returned: 0 in 0.802s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f16d8aff-f65a-40a4-97c7-7160f09a44a6 tempest-VolumesSnapshotListTestJSON-1209810486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.24da0598-4979-49e5-8a42-8bea3472f599 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.7c03f5bc-3b05-4c77-bd24-139e326dad07 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:15 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.24da0598-4979-49e5-8a42-8bea3472f599 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.7c03f5bc-3b05-4c77-bd24-139e326dad07 Nov 03 13:18:15 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:15 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f16d8aff-f65a-40a4-97c7-7160f09a44a6 tempest-VolumesSnapshotListTestJSON-1209810486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.24da0598-4979-49e5-8a42-8bea3472f599 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.7c03f5bc-3b05-4c77-bd24-139e326dad07" returned: 0 in 0.582s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:15 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-f16d8aff-f65a-40a4-97c7-7160f09a44a6 tempest-VolumesSnapshotListTestJSON-1209810486 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.7c03f5bc-3b05-4c77-bd24-139e326dad07 is being set with open permissions: ugo+rw Nov 03 13:18:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f16d8aff-f65a-40a4-97c7-7160f09a44a6 tempest-VolumesSnapshotListTestJSON-1209810486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.7c03f5bc-3b05-4c77-bd24-139e326dad07 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:15 devstack sudo[99793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.7c03f5bc-3b05-4c77-bd24-139e326dad07 Nov 03 13:18:15 devstack sudo[99793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:16 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-e6ff992f-cc1e-4f2e-ac52-3a1bf567aacb req-eaa0a70b-d0d8-4661-bf89-d69bb1b99d73 tempest-TestMinimumBasicScenario-347707430 None] Terminate volume connection completed successfully. Nov 03 13:18:16 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-e6ff992f-cc1e-4f2e-ac52-3a1bf567aacb req-eaa0a70b-d0d8-4661-bf89-d69bb1b99d73 tempest-TestMinimumBasicScenario-347707430 None] Deleting attachment bf9d25e3-dc00-48ec-bdf4-2209de00da53. {{(pid=86725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:18:16 devstack sudo[99793]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f16d8aff-f65a-40a4-97c7-7160f09a44a6 tempest-VolumesSnapshotListTestJSON-1209810486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.7c03f5bc-3b05-4c77-bd24-139e326dad07" returned: 0 in 0.385s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f16d8aff-f65a-40a4-97c7-7160f09a44a6 tempest-VolumesSnapshotListTestJSON-1209810486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.501s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:18:16 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-f16d8aff-f65a-40a4-97c7-7160f09a44a6 tempest-VolumesSnapshotListTestJSON-1209810486 None] Create snapshot completed successfully Nov 03 13:18:16 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e68285e9-33aa-40fc-93a1-69a613f60197 tempest-TestMinimumBasicScenario-347707430 None] Acquiring lock "cinder-b565cfb0-1c2c-445c-8ea2-a5030a89141f-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:18:16 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e68285e9-33aa-40fc-93a1-69a613f60197 tempest-TestMinimumBasicScenario-347707430 None] Lock "cinder-b565cfb0-1c2c-445c-8ea2-a5030a89141f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:18:17 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e68285e9-33aa-40fc-93a1-69a613f60197 tempest-TestMinimumBasicScenario-347707430 None] Acquiring lock "cinder-quobyte-b565cfb0-1c2c-445c-8ea2-a5030a89141f" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:18:17 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e68285e9-33aa-40fc-93a1-69a613f60197 tempest-TestMinimumBasicScenario-347707430 None] Lock "cinder-quobyte-b565cfb0-1c2c-445c-8ea2-a5030a89141f" acquired by "delete_volume" :: waited 0.033s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:18:17 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[0425cc7d-81a8-4282-a090-a1a94c0ba415]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:18:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e68285e9-33aa-40fc-93a1-69a613f60197 tempest-TestMinimumBasicScenario-347707430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b565cfb0-1c2c-445c-8ea2-a5030a89141f {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c17cc280-4d61-41d1-9c1f-7424b9c29e11 tempest-VolumesSnapshotListTestJSON-1209810486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:18:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c17cc280-4d61-41d1-9c1f-7424b9c29e11 tempest-VolumesSnapshotListTestJSON-1209810486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:18:17 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-c17cc280-4d61-41d1-9c1f-7424b9c29e11 tempest-VolumesSnapshotListTestJSON-1209810486 None] Creating offline snapshot 229225d9-611d-4a9c-b59c-7f6f4f588e78 of volume f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:18:17 devstack sudo[99800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b565cfb0-1c2c-445c-8ea2-a5030a89141f Nov 03 13:18:17 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:17 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[980e7a61-cc46-4bde-87e5-6ece127bbb3a]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:18:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c17cc280-4d61-41d1-9c1f-7424b9c29e11 tempest-VolumesSnapshotListTestJSON-1209810486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.7c03f5bc-3b05-4c77-bd24-139e326dad07 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:17 devstack sudo[99802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.7c03f5bc-3b05-4c77-bd24-139e326dad07 Nov 03 13:18:17 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:17 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e68285e9-33aa-40fc-93a1-69a613f60197 tempest-TestMinimumBasicScenario-347707430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b565cfb0-1c2c-445c-8ea2-a5030a89141f" returned: 0 in 0.465s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e68285e9-33aa-40fc-93a1-69a613f60197 tempest-TestMinimumBasicScenario-347707430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b565cfb0-1c2c-445c-8ea2-a5030a89141f {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:17 devstack sudo[99807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b565cfb0-1c2c-445c-8ea2-a5030a89141f Nov 03 13:18:17 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:17 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c17cc280-4d61-41d1-9c1f-7424b9c29e11 tempest-VolumesSnapshotListTestJSON-1209810486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.7c03f5bc-3b05-4c77-bd24-139e326dad07" returned: 0 in 0.463s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:17 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-c17cc280-4d61-41d1-9c1f-7424b9c29e11 tempest-VolumesSnapshotListTestJSON-1209810486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:18:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c17cc280-4d61-41d1-9c1f-7424b9c29e11 tempest-VolumesSnapshotListTestJSON-1209810486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.7c03f5bc-3b05-4c77-bd24-139e326dad07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.229225d9-611d-4a9c-b59c-7f6f4f588e78 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:17 devstack sudo[99812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.7c03f5bc-3b05-4c77-bd24-139e326dad07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.229225d9-611d-4a9c-b59c-7f6f4f588e78 1G Nov 03 13:18:17 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:17 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e68285e9-33aa-40fc-93a1-69a613f60197 tempest-TestMinimumBasicScenario-347707430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b565cfb0-1c2c-445c-8ea2-a5030a89141f" returned: 0 in 0.283s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:17 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e68285e9-33aa-40fc-93a1-69a613f60197 tempest-TestMinimumBasicScenario-347707430 None] Lock "cinder-quobyte-b565cfb0-1c2c-445c-8ea2-a5030a89141f" released by "delete_volume" :: held 0.814s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:18:17 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-e68285e9-33aa-40fc-93a1-69a613f60197 tempest-TestMinimumBasicScenario-347707430 None] Created reservations ['905c6f37-9981-49da-8d63-09d9b28a83ca', '8a7515a2-ee96-4829-af65-62b887e00d5d', '7ed9f866-0b54-411e-8bfb-48c06da29d73', '9cb08074-a4d5-451d-81ee-bf120319939b'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:18:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e68285e9-33aa-40fc-93a1-69a613f60197 tempest-TestMinimumBasicScenario-347707430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:18:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e68285e9-33aa-40fc-93a1-69a613f60197 tempest-TestMinimumBasicScenario-347707430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:18:18 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-e68285e9-33aa-40fc-93a1-69a613f60197 tempest-TestMinimumBasicScenario-347707430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:18:18 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-e68285e9-33aa-40fc-93a1-69a613f60197 tempest-TestMinimumBasicScenario-347707430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:18:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e68285e9-33aa-40fc-93a1-69a613f60197 tempest-TestMinimumBasicScenario-347707430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:18:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e68285e9-33aa-40fc-93a1-69a613f60197 tempest-TestMinimumBasicScenario-347707430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:18 devstack sudo[99817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:18:18 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:18 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e68285e9-33aa-40fc-93a1-69a613f60197 tempest-TestMinimumBasicScenario-347707430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.422s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:18 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-e68285e9-33aa-40fc-93a1-69a613f60197 tempest-TestMinimumBasicScenario-347707430 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:18:18 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-e68285e9-33aa-40fc-93a1-69a613f60197 tempest-TestMinimumBasicScenario-347707430 None] Deleted volume successfully. Nov 03 13:18:18 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e68285e9-33aa-40fc-93a1-69a613f60197 tempest-TestMinimumBasicScenario-347707430 None] Lock "cinder-b565cfb0-1c2c-445c-8ea2-a5030a89141f-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:18:18 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c17cc280-4d61-41d1-9c1f-7424b9c29e11 tempest-VolumesSnapshotListTestJSON-1209810486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.7c03f5bc-3b05-4c77-bd24-139e326dad07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.229225d9-611d-4a9c-b59c-7f6f4f588e78 1G" returned: 0 in 0.804s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c17cc280-4d61-41d1-9c1f-7424b9c29e11 tempest-VolumesSnapshotListTestJSON-1209810486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.7c03f5bc-3b05-4c77-bd24-139e326dad07 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.229225d9-611d-4a9c-b59c-7f6f4f588e78 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:18 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.7c03f5bc-3b05-4c77-bd24-139e326dad07 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.229225d9-611d-4a9c-b59c-7f6f4f588e78 Nov 03 13:18:18 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:19 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c17cc280-4d61-41d1-9c1f-7424b9c29e11 tempest-VolumesSnapshotListTestJSON-1209810486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.7c03f5bc-3b05-4c77-bd24-139e326dad07 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.229225d9-611d-4a9c-b59c-7f6f4f588e78" returned: 0 in 0.495s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:19 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-c17cc280-4d61-41d1-9c1f-7424b9c29e11 tempest-VolumesSnapshotListTestJSON-1209810486 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.229225d9-611d-4a9c-b59c-7f6f4f588e78 is being set with open permissions: ugo+rw Nov 03 13:18:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c17cc280-4d61-41d1-9c1f-7424b9c29e11 tempest-VolumesSnapshotListTestJSON-1209810486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.229225d9-611d-4a9c-b59c-7f6f4f588e78 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:19 devstack sudo[99847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.229225d9-611d-4a9c-b59c-7f6f4f588e78 Nov 03 13:18:19 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:19 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c17cc280-4d61-41d1-9c1f-7424b9c29e11 tempest-VolumesSnapshotListTestJSON-1209810486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.229225d9-611d-4a9c-b59c-7f6f4f588e78" returned: 0 in 0.266s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c17cc280-4d61-41d1-9c1f-7424b9c29e11 tempest-VolumesSnapshotListTestJSON-1209810486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.159s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:18:19 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-c17cc280-4d61-41d1-9c1f-7424b9c29e11 tempest-VolumesSnapshotListTestJSON-1209810486 None] Create snapshot completed successfully Nov 03 13:18:21 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b78c1f4a-ba8c-44c8-a78e-ea1045050e25 tempest-VolumesSnapshotListTestJSON-1209810486 None] Acquiring lock "cinder-229225d9-611d-4a9c-b59c-7f6f4f588e78-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:18:21 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b78c1f4a-ba8c-44c8-a78e-ea1045050e25 tempest-VolumesSnapshotListTestJSON-1209810486 None] Lock "cinder-229225d9-611d-4a9c-b59c-7f6f4f588e78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:18:21 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b78c1f4a-ba8c-44c8-a78e-ea1045050e25 tempest-VolumesSnapshotListTestJSON-1209810486 None] Acquiring lock "cinder-quobyte-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:18:21 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b78c1f4a-ba8c-44c8-a78e-ea1045050e25 tempest-VolumesSnapshotListTestJSON-1209810486 None] Lock "cinder-quobyte-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:18:21 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b78c1f4a-ba8c-44c8-a78e-ea1045050e25 tempest-VolumesSnapshotListTestJSON-1209810486 None] Acquiring lock "cinder-quobyte-229225d9-611d-4a9c-b59c-7f6f4f588e78" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:18:21 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b78c1f4a-ba8c-44c8-a78e-ea1045050e25 tempest-VolumesSnapshotListTestJSON-1209810486 None] Lock "cinder-quobyte-229225d9-611d-4a9c-b59c-7f6f4f588e78" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:18:21 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-b78c1f4a-ba8c-44c8-a78e-ea1045050e25 tempest-VolumesSnapshotListTestJSON-1209810486 None] Deleting offline snapshot 229225d9-611d-4a9c-b59c-7f6f4f588e78 of volume f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:18:21 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-b78c1f4a-ba8c-44c8-a78e-ea1045050e25 tempest-VolumesSnapshotListTestJSON-1209810486 None] snapshot_file for this snap is: volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.229225d9-611d-4a9c-b59c-7f6f4f588e78 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:18:21 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b2af4c-adc7-4b37-ac64-51b59b7c69bd]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:18:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b78c1f4a-ba8c-44c8-a78e-ea1045050e25 tempest-VolumesSnapshotListTestJSON-1209810486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.229225d9-611d-4a9c-b59c-7f6f4f588e78 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:21 devstack sudo[99855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.229225d9-611d-4a9c-b59c-7f6f4f588e78 Nov 03 13:18:21 devstack sudo[99855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:22 devstack sudo[99855]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b78c1f4a-ba8c-44c8-a78e-ea1045050e25 tempest-VolumesSnapshotListTestJSON-1209810486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.229225d9-611d-4a9c-b59c-7f6f4f588e78" returned: 0 in 0.442s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:22 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-b78c1f4a-ba8c-44c8-a78e-ea1045050e25 tempest-VolumesSnapshotListTestJSON-1209810486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:18:22 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[096e97fe-c01b-43ed-8dd3-29a30c80e40a]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:18:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b78c1f4a-ba8c-44c8-a78e-ea1045050e25 tempest-VolumesSnapshotListTestJSON-1209810486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.7c03f5bc-3b05-4c77-bd24-139e326dad07 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:22 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.7c03f5bc-3b05-4c77-bd24-139e326dad07 Nov 03 13:18:22 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:22 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b78c1f4a-ba8c-44c8-a78e-ea1045050e25 tempest-VolumesSnapshotListTestJSON-1209810486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.7c03f5bc-3b05-4c77-bd24-139e326dad07" returned: 0 in 0.446s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:22 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-b78c1f4a-ba8c-44c8-a78e-ea1045050e25 tempest-VolumesSnapshotListTestJSON-1209810486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:18:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b78c1f4a-ba8c-44c8-a78e-ea1045050e25 tempest-VolumesSnapshotListTestJSON-1209810486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.229225d9-611d-4a9c-b59c-7f6f4f588e78 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:22 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.229225d9-611d-4a9c-b59c-7f6f4f588e78 Nov 03 13:18:22 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:23 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b78c1f4a-ba8c-44c8-a78e-ea1045050e25 tempest-VolumesSnapshotListTestJSON-1209810486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.229225d9-611d-4a9c-b59c-7f6f4f588e78" returned: 0 in 0.510s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b78c1f4a-ba8c-44c8-a78e-ea1045050e25 tempest-VolumesSnapshotListTestJSON-1209810486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.229225d9-611d-4a9c-b59c-7f6f4f588e78 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:23 devstack sudo[99872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.229225d9-611d-4a9c-b59c-7f6f4f588e78 Nov 03 13:18:23 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:23 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b78c1f4a-ba8c-44c8-a78e-ea1045050e25 tempest-VolumesSnapshotListTestJSON-1209810486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.229225d9-611d-4a9c-b59c-7f6f4f588e78" returned: 0 in 0.324s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:23 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b78c1f4a-ba8c-44c8-a78e-ea1045050e25 tempest-VolumesSnapshotListTestJSON-1209810486 None] Lock "cinder-quobyte-229225d9-611d-4a9c-b59c-7f6f4f588e78" released by "_delete_snapshot" :: held 1.846s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:18:23 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b78c1f4a-ba8c-44c8-a78e-ea1045050e25 tempest-VolumesSnapshotListTestJSON-1209810486 None] Lock "cinder-quobyte-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55" released by "delete_snapshot" :: held 1.870s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:18:23 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-b78c1f4a-ba8c-44c8-a78e-ea1045050e25 tempest-VolumesSnapshotListTestJSON-1209810486 None] Created reservations ['56cc50db-0270-42b2-8c62-4a18f3c90ca5', 'd78106be-2fb3-49d1-8e97-9e7ffd7e16f1', '52fcf15b-a67a-4a7c-bcd6-8f004b4a646d', '5bca70aa-b95f-43cb-bd43-e58f18475c5d'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:18:23 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-b78c1f4a-ba8c-44c8-a78e-ea1045050e25 tempest-VolumesSnapshotListTestJSON-1209810486 None] Delete snapshot completed successfully. Nov 03 13:18:23 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b78c1f4a-ba8c-44c8-a78e-ea1045050e25 tempest-VolumesSnapshotListTestJSON-1209810486 None] Lock "cinder-229225d9-611d-4a9c-b59c-7f6f4f588e78-delete_snapshot" released by "delete_snapshot" :: held 2.047s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:18:23 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0850c194-e0a4-4ef8-8012-4261f94ac08c tempest-VolumesSnapshotListTestJSON-1209810486 None] Acquiring lock "cinder-7c03f5bc-3b05-4c77-bd24-139e326dad07-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:18:24 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0850c194-e0a4-4ef8-8012-4261f94ac08c tempest-VolumesSnapshotListTestJSON-1209810486 None] Lock "cinder-7c03f5bc-3b05-4c77-bd24-139e326dad07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:18:24 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0850c194-e0a4-4ef8-8012-4261f94ac08c tempest-VolumesSnapshotListTestJSON-1209810486 None] Acquiring lock "cinder-quobyte-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:18:24 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0850c194-e0a4-4ef8-8012-4261f94ac08c tempest-VolumesSnapshotListTestJSON-1209810486 None] Lock "cinder-quobyte-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:18:24 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0850c194-e0a4-4ef8-8012-4261f94ac08c tempest-VolumesSnapshotListTestJSON-1209810486 None] Acquiring lock "cinder-quobyte-7c03f5bc-3b05-4c77-bd24-139e326dad07" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:18:24 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0850c194-e0a4-4ef8-8012-4261f94ac08c tempest-VolumesSnapshotListTestJSON-1209810486 None] Lock "cinder-quobyte-7c03f5bc-3b05-4c77-bd24-139e326dad07" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:18:24 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-0850c194-e0a4-4ef8-8012-4261f94ac08c tempest-VolumesSnapshotListTestJSON-1209810486 None] Deleting offline snapshot 7c03f5bc-3b05-4c77-bd24-139e326dad07 of volume f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:18:24 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-0850c194-e0a4-4ef8-8012-4261f94ac08c tempest-VolumesSnapshotListTestJSON-1209810486 None] snapshot_file for this snap is: volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.7c03f5bc-3b05-4c77-bd24-139e326dad07 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:18:24 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3099cb9-3430-4940-a8cb-67f28ea77abd]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:18:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0850c194-e0a4-4ef8-8012-4261f94ac08c tempest-VolumesSnapshotListTestJSON-1209810486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.7c03f5bc-3b05-4c77-bd24-139e326dad07 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:24 devstack sudo[99875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.7c03f5bc-3b05-4c77-bd24-139e326dad07 Nov 03 13:18:24 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:24 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0850c194-e0a4-4ef8-8012-4261f94ac08c tempest-VolumesSnapshotListTestJSON-1209810486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.7c03f5bc-3b05-4c77-bd24-139e326dad07" returned: 0 in 0.410s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:24 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-0850c194-e0a4-4ef8-8012-4261f94ac08c tempest-VolumesSnapshotListTestJSON-1209810486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:18:24 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0f5545-78ba-43a1-a83b-d055670add9e]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:18:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0850c194-e0a4-4ef8-8012-4261f94ac08c tempest-VolumesSnapshotListTestJSON-1209810486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.24da0598-4979-49e5-8a42-8bea3472f599 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:24 devstack sudo[99880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.24da0598-4979-49e5-8a42-8bea3472f599 Nov 03 13:18:24 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:24 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0850c194-e0a4-4ef8-8012-4261f94ac08c tempest-VolumesSnapshotListTestJSON-1209810486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.24da0598-4979-49e5-8a42-8bea3472f599" returned: 0 in 0.412s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:24 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-0850c194-e0a4-4ef8-8012-4261f94ac08c tempest-VolumesSnapshotListTestJSON-1209810486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:18:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0850c194-e0a4-4ef8-8012-4261f94ac08c tempest-VolumesSnapshotListTestJSON-1209810486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.7c03f5bc-3b05-4c77-bd24-139e326dad07 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:25 devstack sudo[99885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.7c03f5bc-3b05-4c77-bd24-139e326dad07 Nov 03 13:18:25 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:25 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0850c194-e0a4-4ef8-8012-4261f94ac08c tempest-VolumesSnapshotListTestJSON-1209810486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.7c03f5bc-3b05-4c77-bd24-139e326dad07" returned: 0 in 0.508s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0850c194-e0a4-4ef8-8012-4261f94ac08c tempest-VolumesSnapshotListTestJSON-1209810486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.7c03f5bc-3b05-4c77-bd24-139e326dad07 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:25 devstack sudo[99892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.7c03f5bc-3b05-4c77-bd24-139e326dad07 Nov 03 13:18:25 devstack sudo[99892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:25 devstack sudo[99892]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0850c194-e0a4-4ef8-8012-4261f94ac08c tempest-VolumesSnapshotListTestJSON-1209810486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.7c03f5bc-3b05-4c77-bd24-139e326dad07" returned: 0 in 0.346s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0850c194-e0a4-4ef8-8012-4261f94ac08c tempest-VolumesSnapshotListTestJSON-1209810486 None] Lock "cinder-quobyte-7c03f5bc-3b05-4c77-bd24-139e326dad07" released by "_delete_snapshot" :: held 1.868s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:18:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0850c194-e0a4-4ef8-8012-4261f94ac08c tempest-VolumesSnapshotListTestJSON-1209810486 None] Lock "cinder-quobyte-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55" released by "delete_snapshot" :: held 1.904s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:18:26 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-0850c194-e0a4-4ef8-8012-4261f94ac08c tempest-VolumesSnapshotListTestJSON-1209810486 None] Created reservations ['d65cf8d2-9db5-4980-879b-5f9d86a0c0b6', 'c43fa28d-ba3a-424b-9ba3-d059767a82ad', '98583bbb-f817-46a4-91b2-fa6088bcbe39', '1449a261-9511-4e99-b475-927f44e72457'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:18:26 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-0850c194-e0a4-4ef8-8012-4261f94ac08c tempest-VolumesSnapshotListTestJSON-1209810486 None] Delete snapshot completed successfully. Nov 03 13:18:26 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0850c194-e0a4-4ef8-8012-4261f94ac08c tempest-VolumesSnapshotListTestJSON-1209810486 None] Lock "cinder-7c03f5bc-3b05-4c77-bd24-139e326dad07-delete_snapshot" released by "delete_snapshot" :: held 2.129s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:18:26 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c90475a1-08ac-476c-9aab-e6a23645d061 tempest-VolumesSnapshotListTestJSON-1209810486 None] Acquiring lock "cinder-24da0598-4979-49e5-8a42-8bea3472f599-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:18:26 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c90475a1-08ac-476c-9aab-e6a23645d061 tempest-VolumesSnapshotListTestJSON-1209810486 None] Lock "cinder-24da0598-4979-49e5-8a42-8bea3472f599-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:18:26 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c90475a1-08ac-476c-9aab-e6a23645d061 tempest-VolumesSnapshotListTestJSON-1209810486 None] Acquiring lock "cinder-quobyte-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:18:26 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c90475a1-08ac-476c-9aab-e6a23645d061 tempest-VolumesSnapshotListTestJSON-1209810486 None] Lock "cinder-quobyte-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:18:26 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c90475a1-08ac-476c-9aab-e6a23645d061 tempest-VolumesSnapshotListTestJSON-1209810486 None] Acquiring lock "cinder-quobyte-24da0598-4979-49e5-8a42-8bea3472f599" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:18:26 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c90475a1-08ac-476c-9aab-e6a23645d061 tempest-VolumesSnapshotListTestJSON-1209810486 None] Lock "cinder-quobyte-24da0598-4979-49e5-8a42-8bea3472f599" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:18:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-c90475a1-08ac-476c-9aab-e6a23645d061 tempest-VolumesSnapshotListTestJSON-1209810486 None] Deleting offline snapshot 24da0598-4979-49e5-8a42-8bea3472f599 of volume f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:18:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-c90475a1-08ac-476c-9aab-e6a23645d061 tempest-VolumesSnapshotListTestJSON-1209810486 None] snapshot_file for this snap is: volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.24da0598-4979-49e5-8a42-8bea3472f599 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:18:26 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6da9cf7-1c51-4b73-ad16-a07c5618a935]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:18:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c90475a1-08ac-476c-9aab-e6a23645d061 tempest-VolumesSnapshotListTestJSON-1209810486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.24da0598-4979-49e5-8a42-8bea3472f599 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:26 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.24da0598-4979-49e5-8a42-8bea3472f599 Nov 03 13:18:26 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:26 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c90475a1-08ac-476c-9aab-e6a23645d061 tempest-VolumesSnapshotListTestJSON-1209810486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.24da0598-4979-49e5-8a42-8bea3472f599" returned: 0 in 0.467s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-c90475a1-08ac-476c-9aab-e6a23645d061 tempest-VolumesSnapshotListTestJSON-1209810486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:18:26 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b65ab28-2ceb-4fbb-a154-9471f3b881a9]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:18:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c90475a1-08ac-476c-9aab-e6a23645d061 tempest-VolumesSnapshotListTestJSON-1209810486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:26 devstack sudo[99902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55 Nov 03 13:18:26 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:27 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c90475a1-08ac-476c-9aab-e6a23645d061 tempest-VolumesSnapshotListTestJSON-1209810486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55" returned: 0 in 0.394s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c90475a1-08ac-476c-9aab-e6a23645d061 tempest-VolumesSnapshotListTestJSON-1209810486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.24da0598-4979-49e5-8a42-8bea3472f599 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:27 devstack sudo[99907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.24da0598-4979-49e5-8a42-8bea3472f599 Nov 03 13:18:27 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:27 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c90475a1-08ac-476c-9aab-e6a23645d061 tempest-VolumesSnapshotListTestJSON-1209810486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.24da0598-4979-49e5-8a42-8bea3472f599" returned: 0 in 0.377s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c90475a1-08ac-476c-9aab-e6a23645d061 tempest-VolumesSnapshotListTestJSON-1209810486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.24da0598-4979-49e5-8a42-8bea3472f599 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:27 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.24da0598-4979-49e5-8a42-8bea3472f599 Nov 03 13:18:27 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:27 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c90475a1-08ac-476c-9aab-e6a23645d061 tempest-VolumesSnapshotListTestJSON-1209810486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55.24da0598-4979-49e5-8a42-8bea3472f599" returned: 0 in 0.277s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:27 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c90475a1-08ac-476c-9aab-e6a23645d061 tempest-VolumesSnapshotListTestJSON-1209810486 None] Lock "cinder-quobyte-24da0598-4979-49e5-8a42-8bea3472f599" released by "_delete_snapshot" :: held 1.656s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:18:27 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c90475a1-08ac-476c-9aab-e6a23645d061 tempest-VolumesSnapshotListTestJSON-1209810486 None] Lock "cinder-quobyte-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55" released by "delete_snapshot" :: held 1.687s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:18:27 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-c90475a1-08ac-476c-9aab-e6a23645d061 tempest-VolumesSnapshotListTestJSON-1209810486 None] Created reservations ['8a29fd47-4008-44e6-8153-dcf7f33312b5', '68b0e2a4-cc03-4d11-a3b6-089aeb793fea', 'f1a4f5e4-e658-44cb-9598-6928d7d0e11f', '3c0d82b5-10f5-414a-aae3-6a9bf1c6580c'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:18:28 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-c90475a1-08ac-476c-9aab-e6a23645d061 tempest-VolumesSnapshotListTestJSON-1209810486 None] Delete snapshot completed successfully. Nov 03 13:18:28 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c90475a1-08ac-476c-9aab-e6a23645d061 tempest-VolumesSnapshotListTestJSON-1209810486 None] Lock "cinder-24da0598-4979-49e5-8a42-8bea3472f599-delete_snapshot" released by "delete_snapshot" :: held 1.851s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:18:28 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1c4edb4c-edc5-4e04-b1c4-47bf530b31f1 tempest-VolumesSnapshotListTestJSON-1209810486 None] Acquiring lock "cinder-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:18:28 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1c4edb4c-edc5-4e04-b1c4-47bf530b31f1 tempest-VolumesSnapshotListTestJSON-1209810486 None] Lock "cinder-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:18:28 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1c4edb4c-edc5-4e04-b1c4-47bf530b31f1 tempest-VolumesSnapshotListTestJSON-1209810486 None] Acquiring lock "cinder-quobyte-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:18:28 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1c4edb4c-edc5-4e04-b1c4-47bf530b31f1 tempest-VolumesSnapshotListTestJSON-1209810486 None] Lock "cinder-quobyte-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55" acquired by "delete_volume" :: waited 0.027s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:18:28 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1b731f-b7f7-43c2-a9f1-ca149a0e59fb]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:18:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1c4edb4c-edc5-4e04-b1c4-47bf530b31f1 tempest-VolumesSnapshotListTestJSON-1209810486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:28 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55 Nov 03 13:18:28 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:29 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1c4edb4c-edc5-4e04-b1c4-47bf530b31f1 tempest-VolumesSnapshotListTestJSON-1209810486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55" returned: 0 in 0.398s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1c4edb4c-edc5-4e04-b1c4-47bf530b31f1 tempest-VolumesSnapshotListTestJSON-1209810486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:29 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55 Nov 03 13:18:29 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:29 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1c4edb4c-edc5-4e04-b1c4-47bf530b31f1 tempest-VolumesSnapshotListTestJSON-1209810486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55" returned: 0 in 0.272s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:29 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1c4edb4c-edc5-4e04-b1c4-47bf530b31f1 tempest-VolumesSnapshotListTestJSON-1209810486 None] Lock "cinder-quobyte-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55" released by "delete_volume" :: held 0.748s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:18:29 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-1c4edb4c-edc5-4e04-b1c4-47bf530b31f1 tempest-VolumesSnapshotListTestJSON-1209810486 None] Created reservations ['580699c5-7222-46e6-8243-89601e1a40e8', '3354f6ba-5c09-4e4d-9d21-3fbf250e699b', 'e7fbc27f-3ac3-4af1-b176-e5ff33fc4dfc', 'd0bd434c-5b5a-4bad-93fa-9685b71d2dee'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:18:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1c4edb4c-edc5-4e04-b1c4-47bf530b31f1 tempest-VolumesSnapshotListTestJSON-1209810486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:18:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1c4edb4c-edc5-4e04-b1c4-47bf530b31f1 tempest-VolumesSnapshotListTestJSON-1209810486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:18:29 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1c4edb4c-edc5-4e04-b1c4-47bf530b31f1 tempest-VolumesSnapshotListTestJSON-1209810486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:18:29 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1c4edb4c-edc5-4e04-b1c4-47bf530b31f1 tempest-VolumesSnapshotListTestJSON-1209810486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:18:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1c4edb4c-edc5-4e04-b1c4-47bf530b31f1 tempest-VolumesSnapshotListTestJSON-1209810486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:18:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1c4edb4c-edc5-4e04-b1c4-47bf530b31f1 tempest-VolumesSnapshotListTestJSON-1209810486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:29 devstack sudo[99925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:18:29 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:29 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1c4edb4c-edc5-4e04-b1c4-47bf530b31f1 tempest-VolumesSnapshotListTestJSON-1209810486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.269s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:29 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-1c4edb4c-edc5-4e04-b1c4-47bf530b31f1 tempest-VolumesSnapshotListTestJSON-1209810486 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:18:29 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-1c4edb4c-edc5-4e04-b1c4-47bf530b31f1 tempest-VolumesSnapshotListTestJSON-1209810486 None] Deleted volume successfully. Nov 03 13:18:29 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1c4edb4c-edc5-4e04-b1c4-47bf530b31f1 tempest-VolumesSnapshotListTestJSON-1209810486 None] Lock "cinder-f55d5ae0-fd79-46f5-8d6c-f3b97b4c3b55-delete_volume" released by "delete_volume" :: held 1.289s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:18:39 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=74,cinder:UPDATE=107,cinder:DELETE=10,cinder:INSERT=31 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:18:39 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=88,cinder:UPDATE=85,cinder:INSERT=20,cinder:DELETE=5 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:18:58 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:18:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:18:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:18:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:18:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:18:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:18:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:18:58 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:18:58 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:18:59 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Nov 03 13:18:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.365s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:18:59 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:18:59 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager._thread_info {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:18:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread count: 28 {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:18:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread info: [<_MainThread(MainThread, started 133507074375808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:19:06 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:19:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] Flow 'volume_create_manager' (51c59f06-4bb9-4d06-b31d-0d498c797df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:19:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a579b90c-fd0e-4c2e-aa49-9bd661a06cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a579b90c-fd0e-4c2e-aa49-9bd661a06cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-722840297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa9ab7ae-d869-462c-82b0-3c5e472ba607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77ffaf8334d493ba009df0f6af80ea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:19:06Z,use_quota=True,user_id='bc40e920a3904396b8ad36bd0434a8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:19:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f35f02-60a5-40f2-aada-2eb835b3e53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f35f02-60a5-40f2-aada-2eb835b3e53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:19:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8498fe1c-5f74-4a96-828e-4a115748d01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8498fe1c-5f74-4a96-828e-4a115748d01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa9ab7ae-d869-462c-82b0-3c5e472ba607', 'volume_name': 'volume-aa9ab7ae-d869-462c-82b0-3c5e472ba607', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:19:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b049f277-bafd-4148-a05f-d775ec49747b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b049f277-bafd-4148-a05f-d775ec49747b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:19:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf22968b-c359-4e05-b8ef-675bc8e42336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:06 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] Volume aa9ab7ae-d869-462c-82b0-3c5e472ba607: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa9ab7ae-d869-462c-82b0-3c5e472ba607', 'volume_size': 1} Nov 03 13:19:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:19:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:19:06 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-722840297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa9ab7ae-d869-462c-82b0-3c5e472ba607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77ffaf8334d493ba009df0f6af80ea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:19:06Z,use_quota=True,user_id='bc40e920a3904396b8ad36bd0434a8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:19:06 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] Creating volume aa9ab7ae-d869-462c-82b0-3c5e472ba607 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:19:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:19:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:19:06 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:19:06 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:19:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:19:06 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:19:06 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:19:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa9ab7ae-d869-462c-82b0-3c5e472ba607 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:19:06 devstack sudo[100002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa9ab7ae-d869-462c-82b0-3c5e472ba607 1073741824 Nov 03 13:19:06 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:19:06 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root Nov 03 13:19:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa9ab7ae-d869-462c-82b0-3c5e472ba607 1073741824" returned: 0 in 0.547s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:19:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa9ab7ae-d869-462c-82b0-3c5e472ba607 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:19:06 devstack sudo[100009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa9ab7ae-d869-462c-82b0-3c5e472ba607 Nov 03 13:19:06 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:19:07 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root Nov 03 13:19:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa9ab7ae-d869-462c-82b0-3c5e472ba607" returned: 0 in 0.343s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:19:07 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:19:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:19:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf22968b-c359-4e05-b8ef-675bc8e42336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa9ab7ae-d869-462c-82b0-3c5e472ba607', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:19:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e91cdf77-e4f2-4630-be01-a05f055870ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:07 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] Volume volume-aa9ab7ae-d869-462c-82b0-3c5e472ba607 (aa9ab7ae-d869-462c-82b0-3c5e472ba607): created successfully Nov 03 13:19:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e91cdf77-e4f2-4630-be01-a05f055870ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:19:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] Flow 'volume_create_manager' (51c59f06-4bb9-4d06-b31d-0d498c797df8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:19:07 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-0323a59b-5eb2-47f6-b9fc-a9c625b370cc tempest-TestImageHashVerification-2049788620 None] Created volume successfully. Nov 03 13:19:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-40e6fcb4-a8ed-4eee-a272-4043e9584b0d tempest-TestImageHashVerification-2049788620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:19:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-40e6fcb4-a8ed-4eee-a272-4043e9584b0d tempest-TestImageHashVerification-2049788620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:19:09 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[7573859b-44d3-4e5b-bf61-878fc8f4c4d9]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:19:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40e6fcb4-a8ed-4eee-a272-4043e9584b0d tempest-TestImageHashVerification-2049788620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa9ab7ae-d869-462c-82b0-3c5e472ba607 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:19:09 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa9ab7ae-d869-462c-82b0-3c5e472ba607 Nov 03 13:19:09 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:19:10 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Nov 03 13:19:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40e6fcb4-a8ed-4eee-a272-4043e9584b0d tempest-TestImageHashVerification-2049788620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa9ab7ae-d869-462c-82b0-3c5e472ba607" returned: 0 in 0.485s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:19:10 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[91752b1f-f91f-44a2-9669-5840aa377a00]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:19:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40e6fcb4-a8ed-4eee-a272-4043e9584b0d tempest-TestImageHashVerification-2049788620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa9ab7ae-d869-462c-82b0-3c5e472ba607 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:19:10 devstack sudo[100083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa9ab7ae-d869-462c-82b0-3c5e472ba607 Nov 03 13:19:10 devstack sudo[100083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:19:10 devstack sudo[100083]: pam_unix(sudo:session): session closed for user root Nov 03 13:19:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40e6fcb4-a8ed-4eee-a272-4043e9584b0d tempest-TestImageHashVerification-2049788620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa9ab7ae-d869-462c-82b0-3c5e472ba607" returned: 0 in 0.438s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:19:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40e6fcb4-a8ed-4eee-a272-4043e9584b0d tempest-TestImageHashVerification-2049788620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa9ab7ae-d869-462c-82b0-3c5e472ba607 /opt/stack/data/cinder/conversion/aa9ab7ae-d869-462c-82b0-3c5e472ba607.temp_image.4a85f636-6b14-4f20-ad6a-d500eca192fd8kzerqup.img {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:19:10 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa9ab7ae-d869-462c-82b0-3c5e472ba607 /opt/stack/data/cinder/conversion/aa9ab7ae-d869-462c-82b0-3c5e472ba607.temp_image.4a85f636-6b14-4f20-ad6a-d500eca192fd8kzerqup.img Nov 03 13:19:10 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:19:13 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:19:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] Flow 'volume_create_manager' (e690bccf-6b2f-4c4b-a124-0fd3f0b89bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:19:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd5d1d08-9e6c-4f1c-b324-36896841311e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd5d1d08-9e6c-4f1c-b324-36896841311e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-512367343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52444db0154a4da9b7ed939aa3da448b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:19:13Z,use_quota=True,user_id='283adc7c81f54d9b989a99c729f73422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:19:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbd6ab55-e7dc-4f0f-8b86-081fbeab115a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbd6ab55-e7dc-4f0f-8b86-081fbeab115a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:19:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a21fb408-86a5-4d37-9152-88819829a081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a21fb408-86a5-4d37-9152-88819829a081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba', 'volume_name': 'volume-a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:19:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b75f9fa-2385-418a-9fc0-d28b7fffa1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b75f9fa-2385-418a-9fc0-d28b7fffa1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:19:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (026ddf3c-e43f-450f-a247-25fe38d8f082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:13 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] Volume a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba', 'volume_size': 1} Nov 03 13:19:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:19:20 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Nov 03 13:19:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40e6fcb4-a8ed-4eee-a272-4043e9584b0d tempest-TestImageHashVerification-2049788620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa9ab7ae-d869-462c-82b0-3c5e472ba607 /opt/stack/data/cinder/conversion/aa9ab7ae-d869-462c-82b0-3c5e472ba607.temp_image.4a85f636-6b14-4f20-ad6a-d500eca192fd8kzerqup.img" returned: 0 in 9.765s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:19:20 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6e68de-0e54-49ae-ad30-b4744fd31992]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:19:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40e6fcb4-a8ed-4eee-a272-4043e9584b0d tempest-TestImageHashVerification-2049788620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa9ab7ae-d869-462c-82b0-3c5e472ba607 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:19:20 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa9ab7ae-d869-462c-82b0-3c5e472ba607 Nov 03 13:19:20 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:19:21 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Nov 03 13:19:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40e6fcb4-a8ed-4eee-a272-4043e9584b0d tempest-TestImageHashVerification-2049788620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa9ab7ae-d869-462c-82b0-3c5e472ba607" returned: 0 in 0.657s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:19:21 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-40e6fcb4-a8ed-4eee-a272-4043e9584b0d tempest-TestImageHashVerification-2049788620 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa9ab7ae-d869-462c-82b0-3c5e472ba607, size 1024.00 MB, duration 9.77 sec, destination /opt/stack/data/cinder/conversion/aa9ab7ae-d869-462c-82b0-3c5e472ba607.temp_image.4a85f636-6b14-4f20-ad6a-d500eca192fd8kzerqup.img {{(pid=86725) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:19:21 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-40e6fcb4-a8ed-4eee-a272-4043e9584b0d tempest-TestImageHashVerification-2049788620 None] Converted 1024.00 MB image at 104.86 MB/s Nov 03 13:19:21 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-40e6fcb4-a8ed-4eee-a272-4043e9584b0d tempest-TestImageHashVerification-2049788620 None] 4a85f636-6b14-4f20-ad6a-d500eca192fd was raw, no need to convert to raw {{(pid=86725) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 03 13:19:22 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:19:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] Flow 'volume_create_manager' (b23f1a70-6ca7-458d-91f1-d89116cb9968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:19:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79da7e20-ddda-46a6-851d-79c15861e17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79da7e20-ddda-46a6-851d-79c15861e17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1491150168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f9744fb-5c6e-44bb-b675-da63f0f8e616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b770ce917b5542f290c484dfcba9acdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:19:22Z,use_quota=True,user_id='56804fd182dc4f36a3cbaeba02dd62ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:19:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b51c3c0-9070-4b85-aa2c-9495b483d273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b51c3c0-9070-4b85-aa2c-9495b483d273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:19:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4acc3d4-0d9e-4fc3-8375-11bef2361dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4acc3d4-0d9e-4fc3-8375-11bef2361dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f9744fb-5c6e-44bb-b675-da63f0f8e616', 'volume_name': 'volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:19:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ee3faa-a46c-4770-9adc-b0c58ad77340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ee3faa-a46c-4770-9adc-b0c58ad77340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:19:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e115a12-18fe-4af1-aa56-db78cf187b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:22 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] Volume 4f9744fb-5c6e-44bb-b675-da63f0f8e616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616', 'volume_size': 1} Nov 03 13:19:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:19:32 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=8,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:19:32 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:UPDATE=4,cinder:INSERT=1,cinder:SELECT=4 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:19:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-40e6fcb4-a8ed-4eee-a272-4043e9584b0d tempest-TestImageHashVerification-2049788620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.702s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:19:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-40e6fcb4-a8ed-4eee-a272-4043e9584b0d tempest-TestImageHashVerification-2049788620 None] Uploaded volume to glance image-id: 4a85f636-6b14-4f20-ad6a-d500eca192fd. {{(pid=86725) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 13:19:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 30.743s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:19:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-512367343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52444db0154a4da9b7ed939aa3da448b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:19:13Z,use_quota=True,user_id='283adc7c81f54d9b989a99c729f73422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:19:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] Creating volume a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:19:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:19:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:19:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:19:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:19:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:19:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:19:44 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:19:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:19:44 devstack sudo[100251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba 1073741824 Nov 03 13:19:44 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:19:44 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-40e6fcb4-a8ed-4eee-a272-4043e9584b0d tempest-TestImageHashVerification-2049788620 None] Copy volume to image completed successfully. Nov 03 13:19:44 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root Nov 03 13:19:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba 1073741824" returned: 0 in 0.413s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:19:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:19:44 devstack sudo[100257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba Nov 03 13:19:44 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:19:45 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root Nov 03 13:19:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba" returned: 0 in 0.258s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:19:45 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:19:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:19:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.593s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:19:45 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1491150168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f9744fb-5c6e-44bb-b675-da63f0f8e616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b770ce917b5542f290c484dfcba9acdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:19:22Z,use_quota=True,user_id='56804fd182dc4f36a3cbaeba02dd62ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:19:45 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] Creating volume 4f9744fb-5c6e-44bb-b675-da63f0f8e616 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:19:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:19:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:19:45 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:19:45 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:19:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:19:45 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:19:45 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:19:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:19:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (026ddf3c-e43f-450f-a247-25fe38d8f082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:19:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb9ad23-0651-43c4-90aa-6272de0a4fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:45 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616 1073741824 Nov 03 13:19:45 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:19:45 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] Volume volume-a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba (a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba): created successfully Nov 03 13:19:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb9ad23-0651-43c4-90aa-6272de0a4fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:19:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] Flow 'volume_create_manager' (e690bccf-6b2f-4c4b-a124-0fd3f0b89bea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:19:45 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-52c5e5d7-4d46-4f5c-8c96-64da91e2838a tempest-VolumesActionsTest-762657065 None] Created volume successfully. Nov 03 13:19:45 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-55c949dd-4f94-4801-86e9-6e0a422de180 tempest-TestImageHashVerification-2049788620 None] Acquiring lock "cinder-aa9ab7ae-d869-462c-82b0-3c5e472ba607-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:19:45 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-55c949dd-4f94-4801-86e9-6e0a422de180 tempest-TestImageHashVerification-2049788620 None] Lock "cinder-aa9ab7ae-d869-462c-82b0-3c5e472ba607-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:19:45 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-55c949dd-4f94-4801-86e9-6e0a422de180 tempest-TestImageHashVerification-2049788620 None] Acquiring lock "cinder-quobyte-aa9ab7ae-d869-462c-82b0-3c5e472ba607" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:19:45 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-55c949dd-4f94-4801-86e9-6e0a422de180 tempest-TestImageHashVerification-2049788620 None] Lock "cinder-quobyte-aa9ab7ae-d869-462c-82b0-3c5e472ba607" acquired by "delete_volume" :: waited 0.029s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:19:45 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e61642-e8d3-4e93-ae6d-33b2d9fa4447]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:19:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-55c949dd-4f94-4801-86e9-6e0a422de180 tempest-TestImageHashVerification-2049788620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa9ab7ae-d869-462c-82b0-3c5e472ba607 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:19:45 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa9ab7ae-d869-462c-82b0-3c5e472ba607 Nov 03 13:19:45 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:19:45 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Nov 03 13:19:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616 1073741824" returned: 0 in 0.485s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:19:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:19:45 devstack sudo[100269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616 Nov 03 13:19:45 devstack sudo[100269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:19:45 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Nov 03 13:19:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-55c949dd-4f94-4801-86e9-6e0a422de180 tempest-TestImageHashVerification-2049788620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa9ab7ae-d869-462c-82b0-3c5e472ba607" returned: 0 in 0.392s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:19:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-55c949dd-4f94-4801-86e9-6e0a422de180 tempest-TestImageHashVerification-2049788620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa9ab7ae-d869-462c-82b0-3c5e472ba607 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:19:45 devstack sudo[100275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa9ab7ae-d869-462c-82b0-3c5e472ba607 Nov 03 13:19:45 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:19:45 devstack sudo[100269]: pam_unix(sudo:session): session closed for user root Nov 03 13:19:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616" returned: 0 in 0.258s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:19:45 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:19:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:19:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e115a12-18fe-4af1-aa56-db78cf187b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:19:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae067db-6e29-40c7-9608-abe1f234d3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:45 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] Volume volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616 (4f9744fb-5c6e-44bb-b675-da63f0f8e616): created successfully Nov 03 13:19:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae067db-6e29-40c7-9608-abe1f234d3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:19:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] Flow 'volume_create_manager' (b23f1a70-6ca7-458d-91f1-d89116cb9968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:19:45 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-f56f5504-109b-4e0f-98ae-5533878f5fa6 tempest-TestStampPattern-2136190020 None] Created volume successfully. Nov 03 13:19:46 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root Nov 03 13:19:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-55c949dd-4f94-4801-86e9-6e0a422de180 tempest-TestImageHashVerification-2049788620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa9ab7ae-d869-462c-82b0-3c5e472ba607" returned: 0 in 0.267s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:19:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-55c949dd-4f94-4801-86e9-6e0a422de180 tempest-TestImageHashVerification-2049788620 None] Lock "cinder-quobyte-aa9ab7ae-d869-462c-82b0-3c5e472ba607" released by "delete_volume" :: held 0.699s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:19:46 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-55c949dd-4f94-4801-86e9-6e0a422de180 tempest-TestImageHashVerification-2049788620 None] Created reservations ['53cbd761-bc86-4d0c-8c4c-040249240bec', 'f97af7c9-8edd-4f90-985c-d8e5d13190c8', 'd8f12def-7412-4ec0-9377-4ef4767bac02', 'af8c3ff1-1e2c-4b6f-81af-614d14defb0a'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:19:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-55c949dd-4f94-4801-86e9-6e0a422de180 tempest-TestImageHashVerification-2049788620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:19:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-55c949dd-4f94-4801-86e9-6e0a422de180 tempest-TestImageHashVerification-2049788620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:19:46 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-55c949dd-4f94-4801-86e9-6e0a422de180 tempest-TestImageHashVerification-2049788620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:19:46 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-55c949dd-4f94-4801-86e9-6e0a422de180 tempest-TestImageHashVerification-2049788620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:19:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-55c949dd-4f94-4801-86e9-6e0a422de180 tempest-TestImageHashVerification-2049788620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:19:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-55c949dd-4f94-4801-86e9-6e0a422de180 tempest-TestImageHashVerification-2049788620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:19:46 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:19:46 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:19:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-32043390-db9f-49bd-9541-929c862c3b02 tempest-VolumesActionsTest-762657065 None] Acquiring lock "cinder-a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba" by "attach_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:19:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-32043390-db9f-49bd-9541-929c862c3b02 tempest-VolumesActionsTest-762657065 None] Lock "cinder-a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba" acquired by "attach_volume" :: waited 0.015s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:19:46 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-32043390-db9f-49bd-9541-929c862c3b02 tempest-VolumesActionsTest-762657065 None] Attaching volume a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba to instance 04fb83e0-ccf0-4930-ba13-f887367eebca at mountpoint /dev/vdb on host None. Nov 03 13:19:46 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-32043390-db9f-49bd-9541-929c862c3b02 tempest-VolumesActionsTest-762657065 None] Attach volume completed successfully. Nov 03 13:19:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-32043390-db9f-49bd-9541-929c862c3b02 tempest-VolumesActionsTest-762657065 None] Lock "cinder-a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba" released by "attach_volume" :: held 0.083s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:19:46 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Nov 03 13:19:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-55c949dd-4f94-4801-86e9-6e0a422de180 tempest-TestImageHashVerification-2049788620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.295s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:19:46 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-55c949dd-4f94-4801-86e9-6e0a422de180 tempest-TestImageHashVerification-2049788620 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:19:46 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-55c949dd-4f94-4801-86e9-6e0a422de180 tempest-TestImageHashVerification-2049788620 None] Deleted volume successfully. Nov 03 13:19:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-55c949dd-4f94-4801-86e9-6e0a422de180 tempest-TestImageHashVerification-2049788620 None] Lock "cinder-aa9ab7ae-d869-462c-82b0-3c5e472ba607-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:19:46 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-5abddacd-18a8-4ae2-9595-e6305f2605fd tempest-VolumesActionsTest-307827289 None] Terminate volume connection completed successfully. Nov 03 13:19:47 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5abddacd-18a8-4ae2-9595-e6305f2605fd tempest-VolumesActionsTest-307827289 None] Acquiring lock "cinder-a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba-detach_volume" by "detach_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:19:47 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5abddacd-18a8-4ae2-9595-e6305f2605fd tempest-VolumesActionsTest-307827289 None] Lock "cinder-a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:19:47 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-5abddacd-18a8-4ae2-9595-e6305f2605fd tempest-VolumesActionsTest-307827289 None] Detaching volume a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba from instance 04fb83e0-ccf0-4930-ba13-f887367eebca. Nov 03 13:19:47 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-5abddacd-18a8-4ae2-9595-e6305f2605fd tempest-VolumesActionsTest-307827289 None] Detach volume completed successfully. Nov 03 13:19:47 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5abddacd-18a8-4ae2-9595-e6305f2605fd tempest-VolumesActionsTest-307827289 None] Lock "cinder-a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba-detach_volume" released by "detach_volume" :: held 0.066s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:19:47 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-bec2a755-4ded-4210-8f1d-7c40beaf4444 tempest-VolumesActionsTest-762657065 None] Acquiring lock "cinder-a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba-detach_volume" by "detach_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:19:47 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-bec2a755-4ded-4210-8f1d-7c40beaf4444 tempest-VolumesActionsTest-762657065 None] Lock "cinder-a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba-detach_volume" acquired by "detach_volume" :: waited 0.014s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:19:47 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-bec2a755-4ded-4210-8f1d-7c40beaf4444 tempest-VolumesActionsTest-762657065 None] Volume detach called, but volume not attached. Nov 03 13:19:47 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-bec2a755-4ded-4210-8f1d-7c40beaf4444 tempest-VolumesActionsTest-762657065 None] Lock "cinder-a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba-detach_volume" released by "detach_volume" :: held 0.020s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:19:47 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-127b71af-46df-417b-8e93-943192e4b1b1 tempest-VolumesActionsTest-762657065 None] Acquiring lock "cinder-a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:19:47 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-127b71af-46df-417b-8e93-943192e4b1b1 tempest-VolumesActionsTest-762657065 None] Lock "cinder-a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:19:47 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-127b71af-46df-417b-8e93-943192e4b1b1 tempest-VolumesActionsTest-762657065 None] Acquiring lock "cinder-quobyte-a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:19:47 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-127b71af-46df-417b-8e93-943192e4b1b1 tempest-VolumesActionsTest-762657065 None] Lock "cinder-quobyte-a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba" acquired by "delete_volume" :: waited 0.019s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:19:47 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3e0c16-9a11-4b7a-97ce-f725896a03b9]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:19:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-127b71af-46df-417b-8e93-943192e4b1b1 tempest-VolumesActionsTest-762657065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:19:47 devstack sudo[100317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba Nov 03 13:19:47 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:19:48 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root Nov 03 13:19:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-127b71af-46df-417b-8e93-943192e4b1b1 tempest-VolumesActionsTest-762657065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba" returned: 0 in 0.464s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:19:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-127b71af-46df-417b-8e93-943192e4b1b1 tempest-VolumesActionsTest-762657065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:19:48 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba Nov 03 13:19:48 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:19:48 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Nov 03 13:19:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-127b71af-46df-417b-8e93-943192e4b1b1 tempest-VolumesActionsTest-762657065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba" returned: 0 in 0.274s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:19:48 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-127b71af-46df-417b-8e93-943192e4b1b1 tempest-VolumesActionsTest-762657065 None] Lock "cinder-quobyte-a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba" released by "delete_volume" :: held 0.794s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:19:48 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-127b71af-46df-417b-8e93-943192e4b1b1 tempest-VolumesActionsTest-762657065 None] Created reservations ['b38d7f30-b37e-4f5f-8cbc-06035d980959', '4051d66a-6f37-4587-8516-7384ce624123', 'b7b9dd45-687f-4391-aee8-7a0e26479326', '33dd5a96-720a-43df-8e3b-223c3156103f'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:19:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-127b71af-46df-417b-8e93-943192e4b1b1 tempest-VolumesActionsTest-762657065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:19:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-127b71af-46df-417b-8e93-943192e4b1b1 tempest-VolumesActionsTest-762657065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:19:48 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-127b71af-46df-417b-8e93-943192e4b1b1 tempest-VolumesActionsTest-762657065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:19:48 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-127b71af-46df-417b-8e93-943192e4b1b1 tempest-VolumesActionsTest-762657065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:19:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-127b71af-46df-417b-8e93-943192e4b1b1 tempest-VolumesActionsTest-762657065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:19:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-127b71af-46df-417b-8e93-943192e4b1b1 tempest-VolumesActionsTest-762657065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:19:48 devstack sudo[100328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:19:48 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:19:48 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root Nov 03 13:19:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-127b71af-46df-417b-8e93-943192e4b1b1 tempest-VolumesActionsTest-762657065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.264s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:19:48 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-127b71af-46df-417b-8e93-943192e4b1b1 tempest-VolumesActionsTest-762657065 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:19:48 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-127b71af-46df-417b-8e93-943192e4b1b1 tempest-VolumesActionsTest-762657065 None] Deleted volume successfully. Nov 03 13:19:48 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-127b71af-46df-417b-8e93-943192e4b1b1 tempest-VolumesActionsTest-762657065 None] Lock "cinder-a2a0d81e-46b3-42bb-b4b8-7c49ca70ffba-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:19:52 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:19:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] Flow 'volume_create_manager' (efdfc254-54cf-4781-8495-8fb62a8e5fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:19:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca4151a-0e00-4041-b318-1d867c07ec43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca4151a-0e00-4041-b318-1d867c07ec43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-580628570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392da64b-883b-43e4-8641-6646ffc08a1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52444db0154a4da9b7ed939aa3da448b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:19:52Z,use_quota=True,user_id='283adc7c81f54d9b989a99c729f73422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:19:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e3ccd95-c8c2-421f-9181-d8707bfd81b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e3ccd95-c8c2-421f-9181-d8707bfd81b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:19:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a2804f-ab19-4065-8603-5fab22c8862e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a2804f-ab19-4065-8603-5fab22c8862e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '392da64b-883b-43e4-8641-6646ffc08a1c', 'volume_name': 'volume-392da64b-883b-43e4-8641-6646ffc08a1c', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:19:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4daf0eb4-7b6c-4d0e-bea1-1c79f945d1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4daf0eb4-7b6c-4d0e-bea1-1c79f945d1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:19:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4064cd18-fd8c-49fe-ba34-04260cb23179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:52 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] Volume 392da64b-883b-43e4-8641-6646ffc08a1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-392da64b-883b-43e4-8641-6646ffc08a1c', 'volume_size': 1} Nov 03 13:19:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:19:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:19:52 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-580628570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392da64b-883b-43e4-8641-6646ffc08a1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52444db0154a4da9b7ed939aa3da448b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:19:52Z,use_quota=True,user_id='283adc7c81f54d9b989a99c729f73422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:19:52 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] Creating volume 392da64b-883b-43e4-8641-6646ffc08a1c {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:19:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:19:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:19:52 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:19:52 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:19:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:19:52 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:19:52 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:19:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-392da64b-883b-43e4-8641-6646ffc08a1c 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:19:52 devstack sudo[100356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-392da64b-883b-43e4-8641-6646ffc08a1c 1073741824 Nov 03 13:19:52 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:19:52 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root Nov 03 13:19:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-392da64b-883b-43e4-8641-6646ffc08a1c 1073741824" returned: 0 in 0.444s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:19:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-392da64b-883b-43e4-8641-6646ffc08a1c {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:19:52 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-392da64b-883b-43e4-8641-6646ffc08a1c Nov 03 13:19:52 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:19:53 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Nov 03 13:19:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-392da64b-883b-43e4-8641-6646ffc08a1c" returned: 0 in 0.262s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:19:53 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:19:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:19:53 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4064cd18-fd8c-49fe-ba34-04260cb23179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-392da64b-883b-43e4-8641-6646ffc08a1c', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:19:53 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32ff3ab2-6552-47bb-b81b-2af183d379a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:53 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] Volume volume-392da64b-883b-43e4-8641-6646ffc08a1c (392da64b-883b-43e4-8641-6646ffc08a1c): created successfully Nov 03 13:19:53 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32ff3ab2-6552-47bb-b81b-2af183d379a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:19:53 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] Flow 'volume_create_manager' (efdfc254-54cf-4781-8495-8fb62a8e5fe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:19:53 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-ed5d1ada-6b6e-44d7-a33c-cbd86f9bb83b tempest-VolumesActionsTest-762657065 None] Created volume successfully. Nov 03 13:19:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-663a1cde-c937-4abd-8262-3f1a683009d7 req-76fec508-83e6-4916-a383-c00525593e13 tempest-TestStampPattern-2136190020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:19:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-663a1cde-c937-4abd-8262-3f1a683009d7 req-76fec508-83e6-4916-a383-c00525593e13 tempest-TestStampPattern-2136190020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:19:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-663a1cde-c937-4abd-8262-3f1a683009d7 req-76fec508-83e6-4916-a383-c00525593e13 tempest-TestStampPattern-2136190020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:19:54 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-663a1cde-c937-4abd-8262-3f1a683009d7 req-76fec508-83e6-4916-a383-c00525593e13 tempest-TestStampPattern-2136190020 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43', 'name': 'volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1b903f91-abce-43c7-9a56-f51c53955025', 'enforce_multipath': True} {{(pid=86725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:19:54 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1fdd2066-701b-4f2d-bafe-2a9d9ad905ec tempest-VolumesActionsTest-307827289 None] Acquiring lock "cinder-392da64b-883b-43e4-8641-6646ffc08a1c-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:19:54 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1fdd2066-701b-4f2d-bafe-2a9d9ad905ec tempest-VolumesActionsTest-307827289 None] Lock "cinder-392da64b-883b-43e4-8641-6646ffc08a1c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:19:54 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-663a1cde-c937-4abd-8262-3f1a683009d7 req-76fec508-83e6-4916-a383-c00525593e13 tempest-TestStampPattern-2136190020 None] attachment_update completed successfully. Nov 03 13:19:54 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1fdd2066-701b-4f2d-bafe-2a9d9ad905ec tempest-VolumesActionsTest-307827289 None] Acquiring lock "cinder-quobyte-392da64b-883b-43e4-8641-6646ffc08a1c" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:19:54 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1fdd2066-701b-4f2d-bafe-2a9d9ad905ec tempest-VolumesActionsTest-307827289 None] Lock "cinder-quobyte-392da64b-883b-43e4-8641-6646ffc08a1c" acquired by "delete_volume" :: waited 0.027s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:19:54 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d377e6-b63b-4220-9023-10128876f579]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:19:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1fdd2066-701b-4f2d-bafe-2a9d9ad905ec tempest-VolumesActionsTest-307827289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-392da64b-883b-43e4-8641-6646ffc08a1c {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:19:54 devstack sudo[100382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-392da64b-883b-43e4-8641-6646ffc08a1c Nov 03 13:19:54 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:19:55 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root Nov 03 13:19:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1fdd2066-701b-4f2d-bafe-2a9d9ad905ec tempest-VolumesActionsTest-307827289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-392da64b-883b-43e4-8641-6646ffc08a1c" returned: 0 in 0.532s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:19:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1fdd2066-701b-4f2d-bafe-2a9d9ad905ec tempest-VolumesActionsTest-307827289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-392da64b-883b-43e4-8641-6646ffc08a1c {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:19:55 devstack sudo[100802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-392da64b-883b-43e4-8641-6646ffc08a1c Nov 03 13:19:55 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:19:55 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root Nov 03 13:19:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1fdd2066-701b-4f2d-bafe-2a9d9ad905ec tempest-VolumesActionsTest-307827289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-392da64b-883b-43e4-8641-6646ffc08a1c" returned: 0 in 0.350s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:19:55 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1fdd2066-701b-4f2d-bafe-2a9d9ad905ec tempest-VolumesActionsTest-307827289 None] Lock "cinder-quobyte-392da64b-883b-43e4-8641-6646ffc08a1c" released by "delete_volume" :: held 0.947s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:19:55 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-1fdd2066-701b-4f2d-bafe-2a9d9ad905ec tempest-VolumesActionsTest-307827289 None] Created reservations ['d8c09c3f-a912-4789-8070-94444305feac', '518e608b-24cf-406e-840b-57b0a95a26cc', 'ae2cc4ed-da07-4138-8798-5e6686571e63', '5da10e6e-04be-457d-bbc7-57392aa52103'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:19:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1fdd2066-701b-4f2d-bafe-2a9d9ad905ec tempest-VolumesActionsTest-307827289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:19:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1fdd2066-701b-4f2d-bafe-2a9d9ad905ec tempest-VolumesActionsTest-307827289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:19:55 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1fdd2066-701b-4f2d-bafe-2a9d9ad905ec tempest-VolumesActionsTest-307827289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:19:55 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1fdd2066-701b-4f2d-bafe-2a9d9ad905ec tempest-VolumesActionsTest-307827289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:19:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1fdd2066-701b-4f2d-bafe-2a9d9ad905ec tempest-VolumesActionsTest-307827289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:19:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1fdd2066-701b-4f2d-bafe-2a9d9ad905ec tempest-VolumesActionsTest-307827289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:19:55 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:19:55 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:19:56 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Nov 03 13:19:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1fdd2066-701b-4f2d-bafe-2a9d9ad905ec tempest-VolumesActionsTest-307827289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.287s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:19:56 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-1fdd2066-701b-4f2d-bafe-2a9d9ad905ec tempest-VolumesActionsTest-307827289 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:19:56 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-1fdd2066-701b-4f2d-bafe-2a9d9ad905ec tempest-VolumesActionsTest-307827289 None] Deleted volume successfully. Nov 03 13:19:56 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1fdd2066-701b-4f2d-bafe-2a9d9ad905ec tempest-VolumesActionsTest-307827289 None] Lock "cinder-392da64b-883b-43e4-8641-6646ffc08a1c-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:19:57 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:19:57 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] Flow 'volume_create_manager' (9d27bd2e-01c2-4159-9971-b224a448859e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:19:57 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b9825cf-4dd5-4972-9429-599290107ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:57 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b9825cf-4dd5-4972-9429-599290107ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-397290552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c1572a0-66f7-48f6-9a25-6b5c1ae6736a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52444db0154a4da9b7ed939aa3da448b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:19:57Z,use_quota=True,user_id='283adc7c81f54d9b989a99c729f73422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:19:57 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f50934-1fb7-4965-aef6-24285234d93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:57 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f50934-1fb7-4965-aef6-24285234d93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:19:57 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc9a6200-91e6-4c87-bcab-aead737e4c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:57 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc9a6200-91e6-4c87-bcab-aead737e4c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c1572a0-66f7-48f6-9a25-6b5c1ae6736a', 'volume_name': 'volume-3c1572a0-66f7-48f6-9a25-6b5c1ae6736a', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:19:57 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b0ec06f-3a71-413d-91f3-b76902364e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:57 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b0ec06f-3a71-413d-91f3-b76902364e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:19:57 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c83551b5-ffb5-4b5f-8950-dc42a8221fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:57 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] Volume 3c1572a0-66f7-48f6-9a25-6b5c1ae6736a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c1572a0-66f7-48f6-9a25-6b5c1ae6736a', 'volume_size': 1} Nov 03 13:19:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:19:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:19:57 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-397290552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c1572a0-66f7-48f6-9a25-6b5c1ae6736a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52444db0154a4da9b7ed939aa3da448b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:19:57Z,use_quota=True,user_id='283adc7c81f54d9b989a99c729f73422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:19:57 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] Creating volume 3c1572a0-66f7-48f6-9a25-6b5c1ae6736a {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:19:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:19:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:19:57 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:19:57 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:19:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:19:57 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:19:57 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:19:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3c1572a0-66f7-48f6-9a25-6b5c1ae6736a 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:19:57 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3c1572a0-66f7-48f6-9a25-6b5c1ae6736a 1073741824 Nov 03 13:19:57 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:19:58 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Nov 03 13:19:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3c1572a0-66f7-48f6-9a25-6b5c1ae6736a 1073741824" returned: 0 in 0.557s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:19:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3c1572a0-66f7-48f6-9a25-6b5c1ae6736a {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:19:58 devstack sudo[100832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3c1572a0-66f7-48f6-9a25-6b5c1ae6736a Nov 03 13:19:58 devstack sudo[100832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:19:58 devstack sudo[100832]: pam_unix(sudo:session): session closed for user root Nov 03 13:19:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3c1572a0-66f7-48f6-9a25-6b5c1ae6736a" returned: 0 in 0.280s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:19:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:19:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:19:58 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c83551b5-ffb5-4b5f-8950-dc42a8221fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c1572a0-66f7-48f6-9a25-6b5c1ae6736a', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:19:58 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9342c007-e3d9-4465-8977-0d16a2269a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:58 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] Volume volume-3c1572a0-66f7-48f6-9a25-6b5c1ae6736a (3c1572a0-66f7-48f6-9a25-6b5c1ae6736a): created successfully Nov 03 13:19:58 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9342c007-e3d9-4465-8977-0d16a2269a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:19:58 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] Flow 'volume_create_manager' (9d27bd2e-01c2-4159-9971-b224a448859e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:19:58 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-bf9a042c-f9d3-4771-ad95-2dce96cdc1f2 tempest-VolumesActionsTest-762657065 None] Created volume successfully. Nov 03 13:19:58 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:19:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:19:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:19:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:19:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:19:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:19:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:19:58 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:19:58 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:19:59 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Nov 03 13:19:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.265s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:19:59 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:19:59 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager._thread_info {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:19:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread count: 28 {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:19:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread info: [<_MainThread(MainThread, started 133507074375808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:19:59 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:19:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Flow 'volume_create_manager' (62d4b487-99e2-49bf-9ed6-804bf17f7897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:19:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06895814-ca72-4c06-892f-935793de1c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06895814-ca72-4c06-892f-935793de1c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1233727042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aacdffe-af21-447a-9eb3-49866d5e7eb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e606d3785f94582a813611693e1d91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:20:00Z,use_quota=True,user_id='0c423b32b8fd4646b1a5596b9790b769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:19:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a7bf9f4-54fc-4fcb-9fd8-a3b35e7fc677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a7bf9f4-54fc-4fcb-9fd8-a3b35e7fc677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:19:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4232186-0c39-48b4-87ab-17fa09c09499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4232186-0c39-48b4-87ab-17fa09c09499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2aacdffe-af21-447a-9eb3-49866d5e7eb0', 'volume_name': 'volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:19:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22cecbb1-d4c4-42ca-bb97-0c6283b93b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22cecbb1-d4c4-42ca-bb97-0c6283b93b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:19:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (912acb9a-ddb3-4d1a-b71d-16226fdd30e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:19:59 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Volume 2aacdffe-af21-447a-9eb3-49866d5e7eb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0', 'volume_size': 1} Nov 03 13:19:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:19:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:19:59 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1233727042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aacdffe-af21-447a-9eb3-49866d5e7eb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e606d3785f94582a813611693e1d91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:20:00Z,use_quota=True,user_id='0c423b32b8fd4646b1a5596b9790b769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:19:59 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Creating volume 2aacdffe-af21-447a-9eb3-49866d5e7eb0 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:19:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:19:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:19:59 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:19:59 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:19:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:19:59 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:19:59 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:19:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:19:59 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d514cc82-2907-45fd-87dc-33b78285fe84 tempest-VolumesActionsTest-307827289 None] Acquiring lock "cinder-3c1572a0-66f7-48f6-9a25-6b5c1ae6736a-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:19:59 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0 1073741824 Nov 03 13:19:59 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:19:59 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d514cc82-2907-45fd-87dc-33b78285fe84 tempest-VolumesActionsTest-307827289 None] Lock "cinder-3c1572a0-66f7-48f6-9a25-6b5c1ae6736a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:19:59 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d514cc82-2907-45fd-87dc-33b78285fe84 tempest-VolumesActionsTest-307827289 None] Acquiring lock "cinder-quobyte-3c1572a0-66f7-48f6-9a25-6b5c1ae6736a" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:19:59 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d514cc82-2907-45fd-87dc-33b78285fe84 tempest-VolumesActionsTest-307827289 None] Lock "cinder-quobyte-3c1572a0-66f7-48f6-9a25-6b5c1ae6736a" acquired by "delete_volume" :: waited 0.017s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:19:59 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ffbdbf-f927-43bf-9573-aa0c71857f51]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:19:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d514cc82-2907-45fd-87dc-33b78285fe84 tempest-VolumesActionsTest-307827289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3c1572a0-66f7-48f6-9a25-6b5c1ae6736a {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:19:59 devstack sudo[100852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3c1572a0-66f7-48f6-9a25-6b5c1ae6736a Nov 03 13:19:59 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:00 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0 1073741824" returned: 0 in 0.552s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:00 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d514cc82-2907-45fd-87dc-33b78285fe84 tempest-VolumesActionsTest-307827289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3c1572a0-66f7-48f6-9a25-6b5c1ae6736a" returned: 0 in 0.410s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d514cc82-2907-45fd-87dc-33b78285fe84 tempest-VolumesActionsTest-307827289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3c1572a0-66f7-48f6-9a25-6b5c1ae6736a {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:00 devstack sudo[100861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3c1572a0-66f7-48f6-9a25-6b5c1ae6736a Nov 03 13:20:00 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:00 devstack sudo[100864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0 Nov 03 13:20:00 devstack sudo[100864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:00 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-0a015803-6b57-47b3-8765-d7eb7fc747d9 req-5f41ef5e-862d-4303-aff5-9e130bd4fa41 tempest-TestStampPattern-2136190020 None] Terminate volume connection completed successfully. Nov 03 13:20:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-0a015803-6b57-47b3-8765-d7eb7fc747d9 req-5f41ef5e-862d-4303-aff5-9e130bd4fa41 tempest-TestStampPattern-2136190020 None] Deleting attachment 1b903f91-abce-43c7-9a56-f51c53955025. {{(pid=86725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:20:00 devstack sudo[100864]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0" returned: 0 in 0.288s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:00 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:20:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:00 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d514cc82-2907-45fd-87dc-33b78285fe84 tempest-VolumesActionsTest-307827289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3c1572a0-66f7-48f6-9a25-6b5c1ae6736a" returned: 0 in 0.327s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (912acb9a-ddb3-4d1a-b71d-16226fdd30e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db19334f-2a6b-438f-bfcc-3a8456d5e644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d514cc82-2907-45fd-87dc-33b78285fe84 tempest-VolumesActionsTest-307827289 None] Lock "cinder-quobyte-3c1572a0-66f7-48f6-9a25-6b5c1ae6736a" released by "delete_volume" :: held 0.804s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:20:00 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Volume volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0 (2aacdffe-af21-447a-9eb3-49866d5e7eb0): created successfully Nov 03 13:20:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db19334f-2a6b-438f-bfcc-3a8456d5e644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Flow 'volume_create_manager' (62d4b487-99e2-49bf-9ed6-804bf17f7897) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:20:00 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-3d9bb085-c67e-40ef-840d-8e740135c5b6 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Created volume successfully. Nov 03 13:20:00 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-d514cc82-2907-45fd-87dc-33b78285fe84 tempest-VolumesActionsTest-307827289 None] Created reservations ['14a94db3-d360-4585-a784-35b86b74df33', 'cde7340a-1f53-450e-96b7-fee36552e63a', '1dd8f37a-64f0-46e1-83da-014a03867a99', '40e62f64-e355-4f9e-9500-2c4c968d3124'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:20:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d514cc82-2907-45fd-87dc-33b78285fe84 tempest-VolumesActionsTest-307827289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d514cc82-2907-45fd-87dc-33b78285fe84 tempest-VolumesActionsTest-307827289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:00 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d514cc82-2907-45fd-87dc-33b78285fe84 tempest-VolumesActionsTest-307827289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:20:00 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d514cc82-2907-45fd-87dc-33b78285fe84 tempest-VolumesActionsTest-307827289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:20:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d514cc82-2907-45fd-87dc-33b78285fe84 tempest-VolumesActionsTest-307827289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d514cc82-2907-45fd-87dc-33b78285fe84 tempest-VolumesActionsTest-307827289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:00 devstack sudo[100896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:20:00 devstack sudo[100896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:01 devstack sudo[100896]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d514cc82-2907-45fd-87dc-33b78285fe84 tempest-VolumesActionsTest-307827289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.289s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:01 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-d514cc82-2907-45fd-87dc-33b78285fe84 tempest-VolumesActionsTest-307827289 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:20:01 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-d514cc82-2907-45fd-87dc-33b78285fe84 tempest-VolumesActionsTest-307827289 None] Deleted volume successfully. Nov 03 13:20:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d514cc82-2907-45fd-87dc-33b78285fe84 tempest-VolumesActionsTest-307827289 None] Lock "cinder-3c1572a0-66f7-48f6-9a25-6b5c1ae6736a-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:20:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-583d066e-c68b-4096-83de-9b95a0718b60 tempest-TestStampPattern-2136190020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-583d066e-c68b-4096-83de-9b95a0718b60 tempest-TestStampPattern-2136190020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:01 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-583d066e-c68b-4096-83de-9b95a0718b60 tempest-TestStampPattern-2136190020 None] Creating offline snapshot 0b760a85-4429-4311-8437-415298b66e97 of volume 4f9744fb-5c6e-44bb-b675-da63f0f8e616 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:20:01 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:20:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] Flow 'volume_create_manager' (80cc3085-b806-4b67-9702-67d177dcf967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:20:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6719b78a-a8f5-4fb9-926d-49d7e5b40012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:01 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fa82d3-8881-4ce6-8d44-3f9df4921031]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:20:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-583d066e-c68b-4096-83de-9b95a0718b60 tempest-TestStampPattern-2136190020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6719b78a-a8f5-4fb9-926d-49d7e5b40012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1318322937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92aabb15-fa31-4a96-aa6b-fcf521d0a9c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52444db0154a4da9b7ed939aa3da448b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:20:01Z,use_quota=True,user_id='283adc7c81f54d9b989a99c729f73422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed21f4e-131e-4cd8-8115-24f7ba86c41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed21f4e-131e-4cd8-8115-24f7ba86c41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04a42b09-cfed-4def-8b88-8d8d52f76db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04a42b09-cfed-4def-8b88-8d8d52f76db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92aabb15-fa31-4a96-aa6b-fcf521d0a9c9', 'volume_name': 'volume-92aabb15-fa31-4a96-aa6b-fcf521d0a9c9', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2bec21b-07f4-4c2c-a819-79fa5675b8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2bec21b-07f4-4c2c-a819-79fa5675b8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6857a3ba-443e-40e5-99e8-6e3fdc7757ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:01 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] Volume 92aabb15-fa31-4a96-aa6b-fcf521d0a9c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92aabb15-fa31-4a96-aa6b-fcf521d0a9c9', 'volume_size': 1} Nov 03 13:20:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:01 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616 Nov 03 13:20:01 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-633cab46-a91d-4f59-ad3d-e5b45f2f5c1f tempest-CreateVolumesFromSnapshotTest-1721308478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:01 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-583d066e-c68b-4096-83de-9b95a0718b60 tempest-TestStampPattern-2136190020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616" returned: 0 in 0.388s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-583d066e-c68b-4096-83de-9b95a0718b60 tempest-TestStampPattern-2136190020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616.0b760a85-4429-4311-8437-415298b66e97 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:01 devstack sudo[100904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616.0b760a85-4429-4311-8437-415298b66e97 1G Nov 03 13:20:01 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:02 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-583d066e-c68b-4096-83de-9b95a0718b60 tempest-TestStampPattern-2136190020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616.0b760a85-4429-4311-8437-415298b66e97 1G" returned: 0 in 0.406s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-583d066e-c68b-4096-83de-9b95a0718b60 tempest-TestStampPattern-2136190020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616.0b760a85-4429-4311-8437-415298b66e97 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:02 devstack sudo[100909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616.0b760a85-4429-4311-8437-415298b66e97 Nov 03 13:20:02 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:02 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-583d066e-c68b-4096-83de-9b95a0718b60 tempest-TestStampPattern-2136190020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616.0b760a85-4429-4311-8437-415298b66e97" returned: 0 in 0.295s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:02 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-583d066e-c68b-4096-83de-9b95a0718b60 tempest-TestStampPattern-2136190020 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616.0b760a85-4429-4311-8437-415298b66e97 is being set with open permissions: ugo+rw Nov 03 13:20:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-583d066e-c68b-4096-83de-9b95a0718b60 tempest-TestStampPattern-2136190020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616.0b760a85-4429-4311-8437-415298b66e97 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:02 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616.0b760a85-4429-4311-8437-415298b66e97 Nov 03 13:20:02 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:02 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-583d066e-c68b-4096-83de-9b95a0718b60 tempest-TestStampPattern-2136190020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616.0b760a85-4429-4311-8437-415298b66e97" returned: 0 in 0.260s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-583d066e-c68b-4096-83de-9b95a0718b60 tempest-TestStampPattern-2136190020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:02 devstack sudo[100917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616.info Nov 03 13:20:02 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:03 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-583d066e-c68b-4096-83de-9b95a0718b60 tempest-TestStampPattern-2136190020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616.info" returned: 0 in 0.245s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:03 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-583d066e-c68b-4096-83de-9b95a0718b60 tempest-TestStampPattern-2136190020 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616.info is being set with open permissions: ugo+rw Nov 03 13:20:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-583d066e-c68b-4096-83de-9b95a0718b60 tempest-TestStampPattern-2136190020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:03 devstack sudo[100920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616.info Nov 03 13:20:03 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:03 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-583d066e-c68b-4096-83de-9b95a0718b60 tempest-TestStampPattern-2136190020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616.info" returned: 0 in 0.254s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-583d066e-c68b-4096-83de-9b95a0718b60 tempest-TestStampPattern-2136190020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.987s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.872s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:03 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1318322937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92aabb15-fa31-4a96-aa6b-fcf521d0a9c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52444db0154a4da9b7ed939aa3da448b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:20:01Z,use_quota=True,user_id='283adc7c81f54d9b989a99c729f73422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:20:03 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] Creating volume 92aabb15-fa31-4a96-aa6b-fcf521d0a9c9 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:20:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:03 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:20:03 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:20:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:03 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:20:03 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:20:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-92aabb15-fa31-4a96-aa6b-fcf521d0a9c9 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:03 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-92aabb15-fa31-4a96-aa6b-fcf521d0a9c9 1073741824 Nov 03 13:20:03 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:03 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-583d066e-c68b-4096-83de-9b95a0718b60 tempest-TestStampPattern-2136190020 None] Create snapshot completed successfully Nov 03 13:20:03 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-92aabb15-fa31-4a96-aa6b-fcf521d0a9c9 1073741824" returned: 0 in 0.402s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-92aabb15-fa31-4a96-aa6b-fcf521d0a9c9 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:03 devstack sudo[100929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-92aabb15-fa31-4a96-aa6b-fcf521d0a9c9 Nov 03 13:20:03 devstack sudo[100929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:04 devstack sudo[100929]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-92aabb15-fa31-4a96-aa6b-fcf521d0a9c9" returned: 0 in 0.238s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:04 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:20:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-633cab46-a91d-4f59-ad3d-e5b45f2f5c1f tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.338s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6857a3ba-443e-40e5-99e8-6e3fdc7757ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92aabb15-fa31-4a96-aa6b-fcf521d0a9c9', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac5c29a6-d8d1-4748-aa5b-742e1977b64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:04 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-633cab46-a91d-4f59-ad3d-e5b45f2f5c1f tempest-CreateVolumesFromSnapshotTest-1721308478 None] Creating offline snapshot 0072973b-1e3c-408d-b28d-77a177da82e2 of volume 2aacdffe-af21-447a-9eb3-49866d5e7eb0 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:20:04 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] Volume volume-92aabb15-fa31-4a96-aa6b-fcf521d0a9c9 (92aabb15-fa31-4a96-aa6b-fcf521d0a9c9): created successfully Nov 03 13:20:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac5c29a6-d8d1-4748-aa5b-742e1977b64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] Flow 'volume_create_manager' (80cc3085-b806-4b67-9702-67d177dcf967) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:20:04 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f62d172-460b-4f94-abf3-7376c59d12b7]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:20:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-633cab46-a91d-4f59-ad3d-e5b45f2f5c1f tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:04 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-7bad2bd1-c2c8-4c8b-8004-9159ea3067b1 tempest-VolumesActionsTest-762657065 None] Created volume successfully. Nov 03 13:20:04 devstack sudo[100932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0 Nov 03 13:20:04 devstack sudo[100932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:04 devstack sudo[100932]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-633cab46-a91d-4f59-ad3d-e5b45f2f5c1f tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0" returned: 0 in 0.389s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-633cab46-a91d-4f59-ad3d-e5b45f2f5c1f tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0.0072973b-1e3c-408d-b28d-77a177da82e2 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:04 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0.0072973b-1e3c-408d-b28d-77a177da82e2 1G Nov 03 13:20:04 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:04 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-00a2ede0-2cac-4bb9-a0ac-0361a45cce10 tempest-VolumesActionsTest-307827289 None] Acquiring lock "cinder-92aabb15-fa31-4a96-aa6b-fcf521d0a9c9-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:04 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-00a2ede0-2cac-4bb9-a0ac-0361a45cce10 tempest-VolumesActionsTest-307827289 None] Lock "cinder-92aabb15-fa31-4a96-aa6b-fcf521d0a9c9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:04 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-00a2ede0-2cac-4bb9-a0ac-0361a45cce10 tempest-VolumesActionsTest-307827289 None] Acquiring lock "cinder-quobyte-92aabb15-fa31-4a96-aa6b-fcf521d0a9c9" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:04 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-00a2ede0-2cac-4bb9-a0ac-0361a45cce10 tempest-VolumesActionsTest-307827289 None] Lock "cinder-quobyte-92aabb15-fa31-4a96-aa6b-fcf521d0a9c9" acquired by "delete_volume" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:04 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8109980-69cf-4698-834c-03c261137368]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:20:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-00a2ede0-2cac-4bb9-a0ac-0361a45cce10 tempest-VolumesActionsTest-307827289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-92aabb15-fa31-4a96-aa6b-fcf521d0a9c9 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:04 devstack sudo[100941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-92aabb15-fa31-4a96-aa6b-fcf521d0a9c9 Nov 03 13:20:05 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:05 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-633cab46-a91d-4f59-ad3d-e5b45f2f5c1f tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0.0072973b-1e3c-408d-b28d-77a177da82e2 1G" returned: 0 in 0.506s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-633cab46-a91d-4f59-ad3d-e5b45f2f5c1f tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0.0072973b-1e3c-408d-b28d-77a177da82e2 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:05 devstack sudo[100945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0.0072973b-1e3c-408d-b28d-77a177da82e2 Nov 03 13:20:05 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:05 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-00a2ede0-2cac-4bb9-a0ac-0361a45cce10 tempest-VolumesActionsTest-307827289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-92aabb15-fa31-4a96-aa6b-fcf521d0a9c9" returned: 0 in 0.426s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-00a2ede0-2cac-4bb9-a0ac-0361a45cce10 tempest-VolumesActionsTest-307827289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-92aabb15-fa31-4a96-aa6b-fcf521d0a9c9 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:05 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-92aabb15-fa31-4a96-aa6b-fcf521d0a9c9 Nov 03 13:20:05 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:05 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-633cab46-a91d-4f59-ad3d-e5b45f2f5c1f tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0.0072973b-1e3c-408d-b28d-77a177da82e2" returned: 0 in 0.330s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:05 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-633cab46-a91d-4f59-ad3d-e5b45f2f5c1f tempest-CreateVolumesFromSnapshotTest-1721308478 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0.0072973b-1e3c-408d-b28d-77a177da82e2 is being set with open permissions: ugo+rw Nov 03 13:20:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-633cab46-a91d-4f59-ad3d-e5b45f2f5c1f tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0.0072973b-1e3c-408d-b28d-77a177da82e2 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:05 devstack sudo[100955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0.0072973b-1e3c-408d-b28d-77a177da82e2 Nov 03 13:20:05 devstack sudo[100955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:05 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-00a2ede0-2cac-4bb9-a0ac-0361a45cce10 tempest-VolumesActionsTest-307827289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-92aabb15-fa31-4a96-aa6b-fcf521d0a9c9" returned: 0 in 0.269s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:05 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-00a2ede0-2cac-4bb9-a0ac-0361a45cce10 tempest-VolumesActionsTest-307827289 None] Lock "cinder-quobyte-92aabb15-fa31-4a96-aa6b-fcf521d0a9c9" released by "delete_volume" :: held 0.754s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:20:05 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-00a2ede0-2cac-4bb9-a0ac-0361a45cce10 tempest-VolumesActionsTest-307827289 None] Created reservations ['0a764498-c6f7-4ed6-b9f3-0466e53eddca', '9e24df2a-7ccc-48a7-8b9f-f2583a4c3e27', '6992337f-d8d6-4c77-92c5-b82ddad0c284', '7390a229-7fdb-4834-b56c-52aacdaf717f'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:20:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-00a2ede0-2cac-4bb9-a0ac-0361a45cce10 tempest-VolumesActionsTest-307827289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-00a2ede0-2cac-4bb9-a0ac-0361a45cce10 tempest-VolumesActionsTest-307827289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:05 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-00a2ede0-2cac-4bb9-a0ac-0361a45cce10 tempest-VolumesActionsTest-307827289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:20:05 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-00a2ede0-2cac-4bb9-a0ac-0361a45cce10 tempest-VolumesActionsTest-307827289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:20:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-00a2ede0-2cac-4bb9-a0ac-0361a45cce10 tempest-VolumesActionsTest-307827289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-00a2ede0-2cac-4bb9-a0ac-0361a45cce10 tempest-VolumesActionsTest-307827289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:05 devstack sudo[100955]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-633cab46-a91d-4f59-ad3d-e5b45f2f5c1f tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0.0072973b-1e3c-408d-b28d-77a177da82e2" returned: 0 in 0.310s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:05 devstack sudo[100959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:20:05 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-633cab46-a91d-4f59-ad3d-e5b45f2f5c1f tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:05 devstack sudo[100961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0.info Nov 03 13:20:05 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:06 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-00a2ede0-2cac-4bb9-a0ac-0361a45cce10 tempest-VolumesActionsTest-307827289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.378s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:06 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-00a2ede0-2cac-4bb9-a0ac-0361a45cce10 tempest-VolumesActionsTest-307827289 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:20:06 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-00a2ede0-2cac-4bb9-a0ac-0361a45cce10 tempest-VolumesActionsTest-307827289 None] Deleted volume successfully. Nov 03 13:20:06 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-00a2ede0-2cac-4bb9-a0ac-0361a45cce10 tempest-VolumesActionsTest-307827289 None] Lock "cinder-92aabb15-fa31-4a96-aa6b-fcf521d0a9c9-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:20:06 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-633cab46-a91d-4f59-ad3d-e5b45f2f5c1f tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0.info" returned: 0 in 0.386s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:06 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-633cab46-a91d-4f59-ad3d-e5b45f2f5c1f tempest-CreateVolumesFromSnapshotTest-1721308478 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0.info is being set with open permissions: ugo+rw Nov 03 13:20:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-633cab46-a91d-4f59-ad3d-e5b45f2f5c1f tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:06 devstack sudo[100967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0.info Nov 03 13:20:06 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:06 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-633cab46-a91d-4f59-ad3d-e5b45f2f5c1f tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0.info" returned: 0 in 0.276s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-633cab46-a91d-4f59-ad3d-e5b45f2f5c1f tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.334s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:06 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-633cab46-a91d-4f59-ad3d-e5b45f2f5c1f tempest-CreateVolumesFromSnapshotTest-1721308478 None] Create snapshot completed successfully Nov 03 13:20:06 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:20:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] Flow 'volume_create_manager' (6325ee89-b81f-475c-aded-67fe17ef2b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:20:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acadbb31-6dc8-4b8c-9477-17a55770ea36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acadbb31-6dc8-4b8c-9477-17a55770ea36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-327404341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e95bd4c7-22c7-48ac-9f4c-c400992e95b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52444db0154a4da9b7ed939aa3da448b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:20:06Z,use_quota=True,user_id='283adc7c81f54d9b989a99c729f73422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092b2d3a-3226-446b-aeac-066c34d0d447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092b2d3a-3226-446b-aeac-066c34d0d447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad1fbb17-4556-4d7d-84dd-d26d5f24de3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad1fbb17-4556-4d7d-84dd-d26d5f24de3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e95bd4c7-22c7-48ac-9f4c-c400992e95b9', 'volume_name': 'volume-e95bd4c7-22c7-48ac-9f4c-c400992e95b9', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e56f7d8-cdc3-4054-8dcf-26133f11f88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e56f7d8-cdc3-4054-8dcf-26133f11f88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03df63b-112e-4d2b-801e-cfcdfbd0a415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:06 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] Volume e95bd4c7-22c7-48ac-9f4c-c400992e95b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e95bd4c7-22c7-48ac-9f4c-c400992e95b9', 'volume_size': 1} Nov 03 13:20:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:06 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-327404341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e95bd4c7-22c7-48ac-9f4c-c400992e95b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52444db0154a4da9b7ed939aa3da448b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:20:06Z,use_quota=True,user_id='283adc7c81f54d9b989a99c729f73422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:20:06 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] Creating volume e95bd4c7-22c7-48ac-9f4c-c400992e95b9 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:20:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:06 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:20:06 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:20:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:06 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:20:06 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:20:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e95bd4c7-22c7-48ac-9f4c-c400992e95b9 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:06 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e95bd4c7-22c7-48ac-9f4c-c400992e95b9 1073741824 Nov 03 13:20:06 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:07 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e95bd4c7-22c7-48ac-9f4c-c400992e95b9 1073741824" returned: 0 in 0.444s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e95bd4c7-22c7-48ac-9f4c-c400992e95b9 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:07 devstack sudo[100992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e95bd4c7-22c7-48ac-9f4c-c400992e95b9 Nov 03 13:20:07 devstack sudo[100992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:07 devstack sudo[100992]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e95bd4c7-22c7-48ac-9f4c-c400992e95b9" returned: 0 in 0.286s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:07 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:20:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03df63b-112e-4d2b-801e-cfcdfbd0a415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e95bd4c7-22c7-48ac-9f4c-c400992e95b9', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e8a37f-e5cf-479d-b0d3-b55a4e79114c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:07 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] Volume volume-e95bd4c7-22c7-48ac-9f4c-c400992e95b9 (e95bd4c7-22c7-48ac-9f4c-c400992e95b9): created successfully Nov 03 13:20:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e8a37f-e5cf-479d-b0d3-b55a4e79114c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] Flow 'volume_create_manager' (6325ee89-b81f-475c-aded-67fe17ef2b35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:20:07 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-4eadcf95-a0bb-4cf3-8a28-392e27fb5524 tempest-VolumesActionsTest-762657065 None] Created volume successfully. Nov 03 13:20:07 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:20:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Flow 'volume_create_manager' (9f557244-a4f6-4895-be64-0da7d0e3fcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:20:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b7d138-1774-4392-943e-0ac24380d520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b7d138-1774-4392-943e-0ac24380d520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1473818562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d567db95-54ef-4cb3-bf38-e3d57da7574e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e606d3785f94582a813611693e1d91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:20:08Z,use_quota=True,user_id='0c423b32b8fd4646b1a5596b9790b769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90d1539a-d7cc-4ead-b24d-1c4ff8819045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90d1539a-d7cc-4ead-b24d-1c4ff8819045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5dd1ee-d38b-4743-8440-6e5052766159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5dd1ee-d38b-4743-8440-6e5052766159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd567db95-54ef-4cb3-bf38-e3d57da7574e', 'volume_name': 'volume-d567db95-54ef-4cb3-bf38-e3d57da7574e', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad77fb7-62c7-43bf-a874-856e01494d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad77fb7-62c7-43bf-a874-856e01494d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2f2cc1-2f01-441c-ad4d-731931791a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:07 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Volume d567db95-54ef-4cb3-bf38-e3d57da7574e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d567db95-54ef-4cb3-bf38-e3d57da7574e', 'volume_size': 1} Nov 03 13:20:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:07 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1473818562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d567db95-54ef-4cb3-bf38-e3d57da7574e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e606d3785f94582a813611693e1d91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:20:08Z,use_quota=True,user_id='0c423b32b8fd4646b1a5596b9790b769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:20:07 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Creating volume d567db95-54ef-4cb3-bf38-e3d57da7574e {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:20:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:07 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:20:07 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:20:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:07 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:20:07 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:20:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d567db95-54ef-4cb3-bf38-e3d57da7574e 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:07 devstack sudo[101003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d567db95-54ef-4cb3-bf38-e3d57da7574e 1073741824 Nov 03 13:20:07 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Flow 'volume_create_manager' (b078cd44-7d41-47fc-82a5-d60ca0a0d8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c6ae1cb-de76-4071-a11e-7090867128e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c6ae1cb-de76-4071-a11e-7090867128e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-150146360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10ab285a-f425-4be2-a07a-c6d20160739b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e606d3785f94582a813611693e1d91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:20:08Z,use_quota=True,user_id='0c423b32b8fd4646b1a5596b9790b769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a8f2972-a38d-4271-93e4-a02f30411081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a8f2972-a38d-4271-93e4-a02f30411081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d215032b-55a1-4ce7-a02c-be1afcc79d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d215032b-55a1-4ce7-a02c-be1afcc79d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10ab285a-f425-4be2-a07a-c6d20160739b', 'volume_name': 'volume-10ab285a-f425-4be2-a07a-c6d20160739b', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4ac553-903d-45e3-9a67-bee1d3957e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4ac553-903d-45e3-9a67-bee1d3957e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bda9835-f2b9-4277-a925-df6abdc30a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:08 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Volume 10ab285a-f425-4be2-a07a-c6d20160739b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10ab285a-f425-4be2-a07a-c6d20160739b', 'volume_size': 1} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:08 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d567db95-54ef-4cb3-bf38-e3d57da7574e 1073741824" returned: 0 in 0.562s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d567db95-54ef-4cb3-bf38-e3d57da7574e {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:08 devstack sudo[101009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d567db95-54ef-4cb3-bf38-e3d57da7574e Nov 03 13:20:08 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Flow 'volume_create_manager' (e46c5296-b673-49be-9c96-dd542e0d4799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8271d9-cb2d-41bf-96a1-c83db5113f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8271d9-cb2d-41bf-96a1-c83db5113f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1163637573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3a0064c-9245-4f6d-a9ed-afbec29066be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e606d3785f94582a813611693e1d91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:20:08Z,use_quota=True,user_id='0c423b32b8fd4646b1a5596b9790b769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:08 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85a2596e-58e0-47f6-a7ec-7109ca3f42a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85a2596e-58e0-47f6-a7ec-7109ca3f42a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb4f7b5d-f254-497a-8520-1b06697f068e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb4f7b5d-f254-497a-8520-1b06697f068e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3a0064c-9245-4f6d-a9ed-afbec29066be', 'volume_name': 'volume-b3a0064c-9245-4f6d-a9ed-afbec29066be', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ea8e37-4604-4f52-86a3-875fff1a4e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ea8e37-4604-4f52-86a3-875fff1a4e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7186a49-2ee5-40cf-8939-4018e122342e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:08 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Volume b3a0064c-9245-4f6d-a9ed-afbec29066be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3a0064c-9245-4f6d-a9ed-afbec29066be', 'volume_size': 1} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d567db95-54ef-4cb3-bf38-e3d57da7574e" returned: 0 in 0.332s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.510s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-150146360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10ab285a-f425-4be2-a07a-c6d20160739b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e606d3785f94582a813611693e1d91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:20:08Z,use_quota=True,user_id='0c423b32b8fd4646b1a5596b9790b769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Creating volume 10ab285a-f425-4be2-a07a-c6d20160739b {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:20:08 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-10ab285a-f425-4be2-a07a-c6d20160739b 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2f2cc1-2f01-441c-ad4d-731931791a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d567db95-54ef-4cb3-bf38-e3d57da7574e', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:08 devstack sudo[101012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-10ab285a-f425-4be2-a07a-c6d20160739b 1073741824 Nov 03 13:20:08 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d4dfd34-f006-4f40-8ddf-ffdb086b013a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:08 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Volume volume-d567db95-54ef-4cb3-bf38-e3d57da7574e (d567db95-54ef-4cb3-bf38-e3d57da7574e): created successfully Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d4dfd34-f006-4f40-8ddf-ffdb086b013a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Flow 'volume_create_manager' (9f557244-a4f6-4895-be64-0da7d0e3fcb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:20:08 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-aac0b83d-7c51-4596-852d-f479a4badd40 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Created volume successfully. Nov 03 13:20:08 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-58fdc172-75aa-4334-9c26-456dde589d9e tempest-VolumesActionsTest-307827289 None] Acquiring lock "cinder-e95bd4c7-22c7-48ac-9f4c-c400992e95b9-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-58fdc172-75aa-4334-9c26-456dde589d9e tempest-VolumesActionsTest-307827289 None] Lock "cinder-e95bd4c7-22c7-48ac-9f4c-c400992e95b9-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] Flow 'volume_create_manager' (b6e52aa9-9ba6-4673-a52c-2dba129a0746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a915a119-d6f3-45db-b09b-ffa0e5ea9b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a915a119-d6f3-45db-b09b-ffa0e5ea9b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-435534672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=146d5791-c311-4616-b5d2-965d7ac368b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e606d3785f94582a813611693e1d91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:20:09Z,use_quota=True,user_id='0c423b32b8fd4646b1a5596b9790b769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac6b679e-fc5d-401d-81f5-b598c4340e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac6b679e-fc5d-401d-81f5-b598c4340e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d9b75e-8335-4271-95ff-8ea7715922b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d9b75e-8335-4271-95ff-8ea7715922b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '146d5791-c311-4616-b5d2-965d7ac368b6', 'volume_name': 'volume-146d5791-c311-4616-b5d2-965d7ac368b6', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41587fe6-8c4b-45a2-bc6a-ac1ec9274865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41587fe6-8c4b-45a2-bc6a-ac1ec9274865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd718e82-304a-4180-91b5-9ec7ab30fb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:09 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] Volume 146d5791-c311-4616-b5d2-965d7ac368b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-146d5791-c311-4616-b5d2-965d7ac368b6', 'volume_size': 1} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-58fdc172-75aa-4334-9c26-456dde589d9e tempest-VolumesActionsTest-307827289 None] Acquiring lock "cinder-quobyte-e95bd4c7-22c7-48ac-9f4c-c400992e95b9" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-58fdc172-75aa-4334-9c26-456dde589d9e tempest-VolumesActionsTest-307827289 None] Lock "cinder-quobyte-e95bd4c7-22c7-48ac-9f4c-c400992e95b9" acquired by "delete_volume" :: waited 0.028s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e066915-54b0-443c-8789-8e780fbc8c2c]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-58fdc172-75aa-4334-9c26-456dde589d9e tempest-VolumesActionsTest-307827289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e95bd4c7-22c7-48ac-9f4c-c400992e95b9 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:09 devstack sudo[101018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e95bd4c7-22c7-48ac-9f4c-c400992e95b9 Nov 03 13:20:09 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:09 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-10ab285a-f425-4be2-a07a-c6d20160739b 1073741824" returned: 0 in 0.739s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Flow 'volume_create_manager' (84cde704-3e6a-459a-b354-fc73b47c35cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8263927-9d6a-4b5a-99e7-8a01bd00d415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8263927-9d6a-4b5a-99e7-8a01bd00d415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1571738430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12c2d6ec-51ce-4482-b8c2-ee3aeb298bd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e606d3785f94582a813611693e1d91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:20:09Z,use_quota=True,user_id='0c423b32b8fd4646b1a5596b9790b769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2c3720e-f611-48c7-b615-911e4fb08fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2c3720e-f611-48c7-b615-911e4fb08fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc9ae558-7d01-4f19-9f20-356b25e48255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc9ae558-7d01-4f19-9f20-356b25e48255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12c2d6ec-51ce-4482-b8c2-ee3aeb298bd6', 'volume_name': 'volume-12c2d6ec-51ce-4482-b8c2-ee3aeb298bd6', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11950c68-4086-4d02-a8d2-79e3a57024b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11950c68-4086-4d02-a8d2-79e3a57024b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa8f60bf-1d87-402e-9437-a0ee911795a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:09 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Volume 12c2d6ec-51ce-4482-b8c2-ee3aeb298bd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12c2d6ec-51ce-4482-b8c2-ee3aeb298bd6', 'volume_size': 1} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-10ab285a-f425-4be2-a07a-c6d20160739b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:09 devstack sudo[101020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-10ab285a-f425-4be2-a07a-c6d20160739b Nov 03 13:20:09 devstack sudo[101020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:09 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-58fdc172-75aa-4334-9c26-456dde589d9e tempest-VolumesActionsTest-307827289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e95bd4c7-22c7-48ac-9f4c-c400992e95b9" returned: 0 in 0.414s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-58fdc172-75aa-4334-9c26-456dde589d9e tempest-VolumesActionsTest-307827289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e95bd4c7-22c7-48ac-9f4c-c400992e95b9 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:09 devstack sudo[101026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e95bd4c7-22c7-48ac-9f4c-c400992e95b9 Nov 03 13:20:09 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:09 devstack sudo[101020]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-10ab285a-f425-4be2-a07a-c6d20160739b" returned: 0 in 0.262s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.175s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1163637573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3a0064c-9245-4f6d-a9ed-afbec29066be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e606d3785f94582a813611693e1d91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:20:08Z,use_quota=True,user_id='0c423b32b8fd4646b1a5596b9790b769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Creating volume b3a0064c-9245-4f6d-a9ed-afbec29066be {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:20:09 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3a0064c-9245-4f6d-a9ed-afbec29066be 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bda9835-f2b9-4277-a925-df6abdc30a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10ab285a-f425-4be2-a07a-c6d20160739b', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1076fc82-4ea9-44ba-83cb-cd700cb0c25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:09 devstack sudo[101029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3a0064c-9245-4f6d-a9ed-afbec29066be 1073741824 Nov 03 13:20:09 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:09 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Volume volume-10ab285a-f425-4be2-a07a-c6d20160739b (10ab285a-f425-4be2-a07a-c6d20160739b): created successfully Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1076fc82-4ea9-44ba-83cb-cd700cb0c25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Flow 'volume_create_manager' (b078cd44-7d41-47fc-82a5-d60ca0a0d8df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:20:09 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-f9c0b42e-1072-475a-aa35-41725c321fe2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Created volume successfully. Nov 03 13:20:09 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-58fdc172-75aa-4334-9c26-456dde589d9e tempest-VolumesActionsTest-307827289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e95bd4c7-22c7-48ac-9f4c-c400992e95b9" returned: 0 in 0.295s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:10 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-58fdc172-75aa-4334-9c26-456dde589d9e tempest-VolumesActionsTest-307827289 None] Lock "cinder-quobyte-e95bd4c7-22c7-48ac-9f4c-c400992e95b9" released by "delete_volume" :: held 0.779s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:20:10 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-58fdc172-75aa-4334-9c26-456dde589d9e tempest-VolumesActionsTest-307827289 None] Created reservations ['8aa1f186-dfec-4363-b78b-89f7c72031d9', '909d8074-840c-406c-b8b3-68564ba832bc', 'b5ef19d4-7fc2-40d0-88d9-5c70ed214a61', '004b7d8b-6604-449b-b625-1915a07aef98'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:20:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-58fdc172-75aa-4334-9c26-456dde589d9e tempest-VolumesActionsTest-307827289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-58fdc172-75aa-4334-9c26-456dde589d9e tempest-VolumesActionsTest-307827289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:10 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-58fdc172-75aa-4334-9c26-456dde589d9e tempest-VolumesActionsTest-307827289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:20:10 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-58fdc172-75aa-4334-9c26-456dde589d9e tempest-VolumesActionsTest-307827289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:20:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-58fdc172-75aa-4334-9c26-456dde589d9e tempest-VolumesActionsTest-307827289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-58fdc172-75aa-4334-9c26-456dde589d9e tempest-VolumesActionsTest-307827289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:10 devstack sudo[101035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:20:10 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:10 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3a0064c-9245-4f6d-a9ed-afbec29066be 1073741824" returned: 0 in 0.636s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:10 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-58fdc172-75aa-4334-9c26-456dde589d9e tempest-VolumesActionsTest-307827289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.310s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:10 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-58fdc172-75aa-4334-9c26-456dde589d9e tempest-VolumesActionsTest-307827289 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:20:10 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-58fdc172-75aa-4334-9c26-456dde589d9e tempest-VolumesActionsTest-307827289 None] Deleted volume successfully. Nov 03 13:20:10 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-58fdc172-75aa-4334-9c26-456dde589d9e tempest-VolumesActionsTest-307827289 None] Lock "cinder-e95bd4c7-22c7-48ac-9f4c-c400992e95b9-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:20:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3a0064c-9245-4f6d-a9ed-afbec29066be {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:10 devstack sudo[101039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3a0064c-9245-4f6d-a9ed-afbec29066be Nov 03 13:20:10 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:10 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3a0064c-9245-4f6d-a9ed-afbec29066be" returned: 0 in 0.262s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:10 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:20:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.668s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:10 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-435534672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=146d5791-c311-4616-b5d2-965d7ac368b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e606d3785f94582a813611693e1d91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:20:09Z,use_quota=True,user_id='0c423b32b8fd4646b1a5596b9790b769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:20:10 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] Creating volume 146d5791-c311-4616-b5d2-965d7ac368b6 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:20:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:10 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:20:10 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:20:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:10 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:20:10 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:20:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-146d5791-c311-4616-b5d2-965d7ac368b6 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:10 devstack sudo[101042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-146d5791-c311-4616-b5d2-965d7ac368b6 1073741824 Nov 03 13:20:10 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7186a49-2ee5-40cf-8939-4018e122342e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3a0064c-9245-4f6d-a9ed-afbec29066be', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:10 devstack sudo[101042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:10 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (156a9f77-b6c9-409d-be36-4b32ade6303d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:10 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Volume volume-b3a0064c-9245-4f6d-a9ed-afbec29066be (b3a0064c-9245-4f6d-a9ed-afbec29066be): created successfully Nov 03 13:20:10 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (156a9f77-b6c9-409d-be36-4b32ade6303d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:10 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Flow 'volume_create_manager' (e46c5296-b673-49be-9c96-dd542e0d4799) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:20:10 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-f25b42db-4223-4f91-a71c-7bb349d588d0 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Created volume successfully. Nov 03 13:20:11 devstack sudo[101042]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-146d5791-c311-4616-b5d2-965d7ac368b6 1073741824" returned: 0 in 0.505s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-146d5791-c311-4616-b5d2-965d7ac368b6 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:11 devstack sudo[101047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-146d5791-c311-4616-b5d2-965d7ac368b6 Nov 03 13:20:11 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:11 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-146d5791-c311-4616-b5d2-965d7ac368b6" returned: 0 in 0.312s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:11 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:20:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.126s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:11 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1571738430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12c2d6ec-51ce-4482-b8c2-ee3aeb298bd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e606d3785f94582a813611693e1d91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:20:09Z,use_quota=True,user_id='0c423b32b8fd4646b1a5596b9790b769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:20:11 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Creating volume 12c2d6ec-51ce-4482-b8c2-ee3aeb298bd6 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:20:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:11 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:20:11 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:20:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:11 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:20:11 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:20:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-12c2d6ec-51ce-4482-b8c2-ee3aeb298bd6 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:11 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd718e82-304a-4180-91b5-9ec7ab30fb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-146d5791-c311-4616-b5d2-965d7ac368b6', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:11 devstack sudo[101050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-12c2d6ec-51ce-4482-b8c2-ee3aeb298bd6 1073741824 Nov 03 13:20:11 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:11 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbbbbd97-2289-4052-afdc-53eecb644a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:11 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] Volume volume-146d5791-c311-4616-b5d2-965d7ac368b6 (146d5791-c311-4616-b5d2-965d7ac368b6): created successfully Nov 03 13:20:11 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbbbbd97-2289-4052-afdc-53eecb644a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:11 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] Flow 'volume_create_manager' (b6e52aa9-9ba6-4673-a52c-2dba129a0746) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:20:11 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-2bca4044-a55e-40d9-b50b-fe7f409ec5de tempest-CreateVolumesFromSnapshotTest-1721308478 None] Created volume successfully. Nov 03 13:20:11 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:20:11 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] Flow 'volume_create_manager' (b1fcf201-f307-4805-a7e0-f8cf69816281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:20:11 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86022ac3-574c-4838-9f70-ba5197b55ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:11 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86022ac3-574c-4838-9f70-ba5197b55ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-627864253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c604091-5c56-4ee0-b24c-d3698719c7cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52444db0154a4da9b7ed939aa3da448b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:20:12Z,use_quota=True,user_id='283adc7c81f54d9b989a99c729f73422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:11 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (497ae595-20d2-4bae-ba75-1d3f72d371ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:11 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (497ae595-20d2-4bae-ba75-1d3f72d371ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:11 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb9b1ca0-c30d-456f-aad1-84f6eed172c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:11 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb9b1ca0-c30d-456f-aad1-84f6eed172c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c604091-5c56-4ee0-b24c-d3698719c7cc', 'volume_name': 'volume-5c604091-5c56-4ee0-b24c-d3698719c7cc', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:11 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce22654-f5f1-445e-91de-d63afbc31c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:11 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce22654-f5f1-445e-91de-d63afbc31c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:11 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ccb16cb-243c-4896-9ecb-2e9b9aa25848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:11 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] Volume 5c604091-5c56-4ee0-b24c-d3698719c7cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c604091-5c56-4ee0-b24c-d3698719c7cc', 'volume_size': 1} Nov 03 13:20:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:12 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-12c2d6ec-51ce-4482-b8c2-ee3aeb298bd6 1073741824" returned: 0 in 0.503s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-12c2d6ec-51ce-4482-b8c2-ee3aeb298bd6 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:12 devstack sudo[101056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-12c2d6ec-51ce-4482-b8c2-ee3aeb298bd6 Nov 03 13:20:12 devstack sudo[101056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:12 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:20:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Flow 'volume_create_manager' (06370418-90ff-4fa0-8733-349c580de770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:20:12 devstack sudo[101056]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (750f3ab8-caec-4b44-814a-20aa2a57c9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-12c2d6ec-51ce-4482-b8c2-ee3aeb298bd6" returned: 0 in 0.273s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:12 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:20:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.612s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:12 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-627864253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c604091-5c56-4ee0-b24c-d3698719c7cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52444db0154a4da9b7ed939aa3da448b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:20:12Z,use_quota=True,user_id='283adc7c81f54d9b989a99c729f73422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:20:12 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] Creating volume 5c604091-5c56-4ee0-b24c-d3698719c7cc {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:20:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:12 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:20:12 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:20:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:12 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:20:12 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:20:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5c604091-5c56-4ee0-b24c-d3698719c7cc 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (750f3ab8-caec-4b44-814a-20aa2a57c9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1094715509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fe549b9-6a6d-4ba1-aca4-a4c668a3c800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b770ce917b5542f290c484dfcba9acdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0b760a85-4429-4311-8437-415298b66e97,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:20:12Z,use_quota=True,user_id='56804fd182dc4f36a3cbaeba02dd62ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10deab6b-5a19-4fa7-9dd6-2bcb134b452a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:12 devstack sudo[101059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5c604091-5c56-4ee0-b24c-d3698719c7cc 1073741824 Nov 03 13:20:12 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10deab6b-5a19-4fa7-9dd6-2bcb134b452a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (628fb7b4-db56-4b42-a8c7-5c29e95265de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (628fb7b4-db56-4b42-a8c7-5c29e95265de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5fe549b9-6a6d-4ba1-aca4-a4c668a3c800', 'volume_name': 'volume-5fe549b9-6a6d-4ba1-aca4-a4c668a3c800', 'volume_size': 1, 'snapshot_id': '0b760a85-4429-4311-8437-415298b66e97'}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96004d6f-1255-4e1c-8cfd-2ea22d7eeb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96004d6f-1255-4e1c-8cfd-2ea22d7eeb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb35753f-8912-4034-acf8-a06684abd0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:12 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Volume 5fe549b9-6a6d-4ba1-aca4-a4c668a3c800: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5fe549b9-6a6d-4ba1-aca4-a4c668a3c800', 'volume_size': 1, 'snapshot_id': '0b760a85-4429-4311-8437-415298b66e97'} Nov 03 13:20:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa8f60bf-1d87-402e-9437-a0ee911795a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12c2d6ec-51ce-4482-b8c2-ee3aeb298bd6', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ebbb4d-f35a-4d45-9c96-f975cadcce21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:12 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Volume volume-12c2d6ec-51ce-4482-b8c2-ee3aeb298bd6 (12c2d6ec-51ce-4482-b8c2-ee3aeb298bd6): created successfully Nov 03 13:20:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ebbb4d-f35a-4d45-9c96-f975cadcce21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Flow 'volume_create_manager' (84cde704-3e6a-459a-b354-fc73b47c35cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:20:12 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-a145978b-a99e-4f67-9bfd-49580a3b3305 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Created volume successfully. Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-326093c1-e8b1-456d-a1a2-db0124f58c70 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Acquiring lock "cinder-12c2d6ec-51ce-4482-b8c2-ee3aeb298bd6-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-326093c1-e8b1-456d-a1a2-db0124f58c70 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "cinder-12c2d6ec-51ce-4482-b8c2-ee3aeb298bd6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-326093c1-e8b1-456d-a1a2-db0124f58c70 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Acquiring lock "cinder-quobyte-12c2d6ec-51ce-4482-b8c2-ee3aeb298bd6" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-326093c1-e8b1-456d-a1a2-db0124f58c70 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "cinder-quobyte-12c2d6ec-51ce-4482-b8c2-ee3aeb298bd6" acquired by "delete_volume" :: waited 0.021s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5d54c3-0864-4f04-b5a7-145ab38729a7]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-326093c1-e8b1-456d-a1a2-db0124f58c70 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-12c2d6ec-51ce-4482-b8c2-ee3aeb298bd6 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:13 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5c604091-5c56-4ee0-b24c-d3698719c7cc 1073741824" returned: 0 in 0.601s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5c604091-5c56-4ee0-b24c-d3698719c7cc {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:13 devstack sudo[101066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5c604091-5c56-4ee0-b24c-d3698719c7cc Nov 03 13:20:13 devstack sudo[101066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:13 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-12c2d6ec-51ce-4482-b8c2-ee3aeb298bd6 Nov 03 13:20:13 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:13 devstack sudo[101066]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5c604091-5c56-4ee0-b24c-d3698719c7cc" returned: 0 in 0.292s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.864s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Acquiring lock "cinder-quobyte-0b760a85-4429-4311-8437-415298b66e97-5fe549b9-6a6d-4ba1-aca4-a4c668a3c800" by "_create_volume_from_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ccb16cb-243c-4896-9ecb-2e9b9aa25848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c604091-5c56-4ee0-b24c-d3698719c7cc', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f897001c-e183-4424-8e4b-52289e8e8e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Lock "cinder-quobyte-0b760a85-4429-4311-8437-415298b66e97-5fe549b9-6a6d-4ba1-aca4-a4c668a3c800" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Creating volume 5fe549b9-6a6d-4ba1-aca4-a4c668a3c800 from snapshot 0b760a85-4429-4311-8437-415298b66e97 {{(pid=86725) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Acquiring lock "cinder-quobyte-5fe549b9-6a6d-4ba1-aca4-a4c668a3c800" by "_copy_volume_from_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:13 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-326093c1-e8b1-456d-a1a2-db0124f58c70 tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-12c2d6ec-51ce-4482-b8c2-ee3aeb298bd6" returned: 0 in 0.410s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-326093c1-e8b1-456d-a1a2-db0124f58c70 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-12c2d6ec-51ce-4482-b8c2-ee3aeb298bd6 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:13 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] Volume volume-5c604091-5c56-4ee0-b24c-d3698719c7cc (5c604091-5c56-4ee0-b24c-d3698719c7cc): created successfully Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f897001c-e183-4424-8e4b-52289e8e8e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] Flow 'volume_create_manager' (b1fcf201-f307-4805-a7e0-f8cf69816281) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:20:13 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-12c2d6ec-51ce-4482-b8c2-ee3aeb298bd6 Nov 03 13:20:13 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Lock "cinder-quobyte-5fe549b9-6a6d-4ba1-aca4-a4c668a3c800" acquired by "_copy_volume_from_snapshot" :: waited 0.052s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] snapshot: 0b760a85-4429-4311-8437-415298b66e97, volume: 5fe549b9-6a6d-4ba1-aca4-a4c668a3c800, {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:13 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-065747c7-6a62-42aa-981d-57866979a0d7 tempest-VolumesActionsTest-762657065 None] Created volume successfully. Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bab7656-77f5-42f8-aeba-668c99c3f8f2]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616.0b760a85-4429-4311-8437-415298b66e97 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:13 devstack sudo[101078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616.0b760a85-4429-4311-8437-415298b66e97 Nov 03 13:20:13 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:13 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-326093c1-e8b1-456d-a1a2-db0124f58c70 tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-12c2d6ec-51ce-4482-b8c2-ee3aeb298bd6" returned: 0 in 0.318s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:13 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-326093c1-e8b1-456d-a1a2-db0124f58c70 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "cinder-quobyte-12c2d6ec-51ce-4482-b8c2-ee3aeb298bd6" released by "delete_volume" :: held 0.789s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:20:14 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-326093c1-e8b1-456d-a1a2-db0124f58c70 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Created reservations ['3397ac34-9bca-4185-9592-24766801c1d5', 'b16df63b-45b5-49a0-b707-6ab2fe045aca', 'b05ba371-20ed-46cf-bc1c-c6dff2c8b7c5', 'ad8a557c-b230-4a5a-98d6-56abf05efab9'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:20:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-326093c1-e8b1-456d-a1a2-db0124f58c70 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-326093c1-e8b1-456d-a1a2-db0124f58c70 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:14 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-326093c1-e8b1-456d-a1a2-db0124f58c70 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:20:14 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-326093c1-e8b1-456d-a1a2-db0124f58c70 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:20:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-326093c1-e8b1-456d-a1a2-db0124f58c70 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-326093c1-e8b1-456d-a1a2-db0124f58c70 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:14 devstack sudo[101082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:20:14 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:14 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616.0b760a85-4429-4311-8437-415298b66e97" returned: 0 in 0.580s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:14 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:20:14 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[76188685-c59f-49d3-ad6a-47533d6f34cb]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:20:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:14 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-96cd819f-3e9a-42c9-a61f-cf6a7b63ba2d tempest-CreateVolumesFromSnapshotTest-1721308478 None] Acquiring lock "cinder-146d5791-c311-4616-b5d2-965d7ac368b6-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:14 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-96cd819f-3e9a-42c9-a61f-cf6a7b63ba2d tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "cinder-146d5791-c311-4616-b5d2-965d7ac368b6-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:14 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-96cd819f-3e9a-42c9-a61f-cf6a7b63ba2d tempest-CreateVolumesFromSnapshotTest-1721308478 None] Acquiring lock "cinder-quobyte-146d5791-c311-4616-b5d2-965d7ac368b6" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:14 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-96cd819f-3e9a-42c9-a61f-cf6a7b63ba2d tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "cinder-quobyte-146d5791-c311-4616-b5d2-965d7ac368b6" acquired by "delete_volume" :: waited 0.027s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:14 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:14 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9b8919-3b8f-4280-a282-6fc1a97e30af]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:20:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-96cd819f-3e9a-42c9-a61f-cf6a7b63ba2d tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-146d5791-c311-4616-b5d2-965d7ac368b6 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-326093c1-e8b1-456d-a1a2-db0124f58c70 tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.423s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:14 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-326093c1-e8b1-456d-a1a2-db0124f58c70 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:20:14 devstack sudo[101089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616 Nov 03 13:20:14 devstack sudo[101089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:14 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-326093c1-e8b1-456d-a1a2-db0124f58c70 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Deleted volume successfully. Nov 03 13:20:14 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-326093c1-e8b1-456d-a1a2-db0124f58c70 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "cinder-12c2d6ec-51ce-4482-b8c2-ee3aeb298bd6-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:20:14 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-146d5791-c311-4616-b5d2-965d7ac368b6 Nov 03 13:20:14 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:14 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a8c72f02-6888-4efb-a76c-261a3ad242ca tempest-VolumesActionsTest-762657065 None] Acquiring lock "cinder-5c604091-5c56-4ee0-b24c-d3698719c7cc-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:14 devstack sudo[101089]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:14 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a8c72f02-6888-4efb-a76c-261a3ad242ca tempest-VolumesActionsTest-762657065 None] Lock "cinder-5c604091-5c56-4ee0-b24c-d3698719c7cc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616" returned: 0 in 0.613s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:14 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616 {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 13:20:14 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Creating direct copy from snapshot {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 13:20:14 devstack cinder-volume[86725]: DEBUG cinder.utils [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Path /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5fe549b9-6a6d-4ba1-aca4-a4c668a3c800 not found in is_blk_device check {{(pid=86725) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 13:20:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5fe549b9-6a6d-4ba1-aca4-a4c668a3c800 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:14 devstack sudo[101097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5fe549b9-6a6d-4ba1-aca4-a4c668a3c800 Nov 03 13:20:14 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:14 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a8c72f02-6888-4efb-a76c-261a3ad242ca tempest-VolumesActionsTest-762657065 None] Acquiring lock "cinder-quobyte-5c604091-5c56-4ee0-b24c-d3698719c7cc" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:14 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a8c72f02-6888-4efb-a76c-261a3ad242ca tempest-VolumesActionsTest-762657065 None] Lock "cinder-quobyte-5c604091-5c56-4ee0-b24c-d3698719c7cc" acquired by "delete_volume" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:15 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ae9421-6bd7-440a-955d-92e35a6f6fae]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:20:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a8c72f02-6888-4efb-a76c-261a3ad242ca tempest-VolumesActionsTest-762657065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5c604091-5c56-4ee0-b24c-d3698719c7cc {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:15 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-96cd819f-3e9a-42c9-a61f-cf6a7b63ba2d tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-146d5791-c311-4616-b5d2-965d7ac368b6" returned: 0 in 0.561s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-96cd819f-3e9a-42c9-a61f-cf6a7b63ba2d tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-146d5791-c311-4616-b5d2-965d7ac368b6 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:15 devstack sudo[101103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-146d5791-c311-4616-b5d2-965d7ac368b6 Nov 03 13:20:15 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:15 devstack sudo[101102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5c604091-5c56-4ee0-b24c-d3698719c7cc Nov 03 13:20:15 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:15 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-96cd819f-3e9a-42c9-a61f-cf6a7b63ba2d tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-146d5791-c311-4616-b5d2-965d7ac368b6" returned: 0 in 0.382s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:15 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-96cd819f-3e9a-42c9-a61f-cf6a7b63ba2d tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "cinder-quobyte-146d5791-c311-4616-b5d2-965d7ac368b6" released by "delete_volume" :: held 1.054s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:20:15 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-96cd819f-3e9a-42c9-a61f-cf6a7b63ba2d tempest-CreateVolumesFromSnapshotTest-1721308478 None] Created reservations ['e64a1841-5189-4d5e-8a70-e2cb10034c8f', 'e78a7fb2-5365-4425-9802-65560fac6c28', '18088fbf-12be-4c49-9f71-85c0cf3cca35', 'b07cd618-362f-472a-b1a2-8460c171fa1a'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:20:15 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a8c72f02-6888-4efb-a76c-261a3ad242ca tempest-VolumesActionsTest-762657065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5c604091-5c56-4ee0-b24c-d3698719c7cc" returned: 0 in 0.806s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a8c72f02-6888-4efb-a76c-261a3ad242ca tempest-VolumesActionsTest-762657065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5c604091-5c56-4ee0-b24c-d3698719c7cc {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-96cd819f-3e9a-42c9-a61f-cf6a7b63ba2d tempest-CreateVolumesFromSnapshotTest-1721308478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-96cd819f-3e9a-42c9-a61f-cf6a7b63ba2d tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:15 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-96cd819f-3e9a-42c9-a61f-cf6a7b63ba2d tempest-CreateVolumesFromSnapshotTest-1721308478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:20:15 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-96cd819f-3e9a-42c9-a61f-cf6a7b63ba2d tempest-CreateVolumesFromSnapshotTest-1721308478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:20:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-96cd819f-3e9a-42c9-a61f-cf6a7b63ba2d tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-96cd819f-3e9a-42c9-a61f-cf6a7b63ba2d tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:15 devstack sudo[101121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5c604091-5c56-4ee0-b24c-d3698719c7cc Nov 03 13:20:15 devstack sudo[101121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:16 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:20:16 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:16 devstack sudo[101121]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a8c72f02-6888-4efb-a76c-261a3ad242ca tempest-VolumesActionsTest-762657065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5c604091-5c56-4ee0-b24c-d3698719c7cc" returned: 0 in 0.543s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:16 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a8c72f02-6888-4efb-a76c-261a3ad242ca tempest-VolumesActionsTest-762657065 None] Lock "cinder-quobyte-5c604091-5c56-4ee0-b24c-d3698719c7cc" released by "delete_volume" :: held 1.442s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:20:16 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-96cd819f-3e9a-42c9-a61f-cf6a7b63ba2d tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.661s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:16 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-96cd819f-3e9a-42c9-a61f-cf6a7b63ba2d tempest-CreateVolumesFromSnapshotTest-1721308478 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:20:16 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-a8c72f02-6888-4efb-a76c-261a3ad242ca tempest-VolumesActionsTest-762657065 None] Created reservations ['6a1a3280-b365-4ab2-805a-641e6a6746bd', '897293a4-9a85-4f14-a9a3-354cf078e482', 'cc75d4f5-c6d8-4b84-a6d9-562e5b8127d0', 'c267f11c-307f-47b0-b5b7-2296addfb8d2'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:20:16 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-96cd819f-3e9a-42c9-a61f-cf6a7b63ba2d tempest-CreateVolumesFromSnapshotTest-1721308478 None] Deleted volume successfully. Nov 03 13:20:16 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-96cd819f-3e9a-42c9-a61f-cf6a7b63ba2d tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "cinder-146d5791-c311-4616-b5d2-965d7ac368b6-delete_volume" released by "delete_volume" :: held 2.312s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:20:16 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-661117e4-1d5d-466f-a944-c21057a02db3 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Acquiring lock "cinder-b3a0064c-9245-4f6d-a9ed-afbec29066be-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:16 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-661117e4-1d5d-466f-a944-c21057a02db3 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "cinder-b3a0064c-9245-4f6d-a9ed-afbec29066be-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a8c72f02-6888-4efb-a76c-261a3ad242ca tempest-VolumesActionsTest-762657065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a8c72f02-6888-4efb-a76c-261a3ad242ca tempest-VolumesActionsTest-762657065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:16 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a8c72f02-6888-4efb-a76c-261a3ad242ca tempest-VolumesActionsTest-762657065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:20:16 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a8c72f02-6888-4efb-a76c-261a3ad242ca tempest-VolumesActionsTest-762657065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:20:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a8c72f02-6888-4efb-a76c-261a3ad242ca tempest-VolumesActionsTest-762657065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a8c72f02-6888-4efb-a76c-261a3ad242ca tempest-VolumesActionsTest-762657065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:16 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-661117e4-1d5d-466f-a944-c21057a02db3 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Acquiring lock "cinder-quobyte-b3a0064c-9245-4f6d-a9ed-afbec29066be" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:17 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:20:17 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-661117e4-1d5d-466f-a944-c21057a02db3 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "cinder-quobyte-b3a0064c-9245-4f6d-a9ed-afbec29066be" acquired by "delete_volume" :: waited 0.042s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:17 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:17 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca367db-b85b-4b23-8256-b841afaafc0a]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:20:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-661117e4-1d5d-466f-a944-c21057a02db3 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3a0064c-9245-4f6d-a9ed-afbec29066be {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:17 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3a0064c-9245-4f6d-a9ed-afbec29066be Nov 03 13:20:17 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:17 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a8c72f02-6888-4efb-a76c-261a3ad242ca tempest-VolumesActionsTest-762657065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.759s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:17 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-a8c72f02-6888-4efb-a76c-261a3ad242ca tempest-VolumesActionsTest-762657065 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:20:17 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-a8c72f02-6888-4efb-a76c-261a3ad242ca tempest-VolumesActionsTest-762657065 None] Deleted volume successfully. Nov 03 13:20:17 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a8c72f02-6888-4efb-a76c-261a3ad242ca tempest-VolumesActionsTest-762657065 None] Lock "cinder-5c604091-5c56-4ee0-b24c-d3698719c7cc-delete_volume" released by "delete_volume" :: held 2.957s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:20:18 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-661117e4-1d5d-466f-a944-c21057a02db3 tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3a0064c-9245-4f6d-a9ed-afbec29066be" returned: 0 in 1.258s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-661117e4-1d5d-466f-a944-c21057a02db3 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3a0064c-9245-4f6d-a9ed-afbec29066be {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:18 devstack sudo[101138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3a0064c-9245-4f6d-a9ed-afbec29066be Nov 03 13:20:18 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:18 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-661117e4-1d5d-466f-a944-c21057a02db3 tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3a0064c-9245-4f6d-a9ed-afbec29066be" returned: 0 in 0.537s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:19 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-661117e4-1d5d-466f-a944-c21057a02db3 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "cinder-quobyte-b3a0064c-9245-4f6d-a9ed-afbec29066be" released by "delete_volume" :: held 1.970s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:20:19 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-661117e4-1d5d-466f-a944-c21057a02db3 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Created reservations ['bf4fe713-a77c-46cc-9c99-69cce8e092ca', '14893f71-9ee0-4e8d-8cce-93cab08beac3', '35555b23-670e-4fce-aeb7-56daeed39701', 'ea80cc6e-c762-419b-8dde-8f075ad639af'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:20:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-661117e4-1d5d-466f-a944-c21057a02db3 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-661117e4-1d5d-466f-a944-c21057a02db3 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:19 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-661117e4-1d5d-466f-a944-c21057a02db3 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:20:19 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-661117e4-1d5d-466f-a944-c21057a02db3 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:20:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-661117e4-1d5d-466f-a944-c21057a02db3 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-661117e4-1d5d-466f-a944-c21057a02db3 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:19 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:20:19 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:19 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-661117e4-1d5d-466f-a944-c21057a02db3 tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.673s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:20 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-661117e4-1d5d-466f-a944-c21057a02db3 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:20:20 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-661117e4-1d5d-466f-a944-c21057a02db3 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Deleted volume successfully. Nov 03 13:20:20 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-661117e4-1d5d-466f-a944-c21057a02db3 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "cinder-b3a0064c-9245-4f6d-a9ed-afbec29066be-delete_volume" released by "delete_volume" :: held 3.301s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:20:20 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d5b159e1-0629-44fa-8e10-298ed9dc967e tempest-CreateVolumesFromSnapshotTest-1721308478 None] Acquiring lock "cinder-10ab285a-f425-4be2-a07a-c6d20160739b-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:20 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d5b159e1-0629-44fa-8e10-298ed9dc967e tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "cinder-10ab285a-f425-4be2-a07a-c6d20160739b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:20 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d5b159e1-0629-44fa-8e10-298ed9dc967e tempest-CreateVolumesFromSnapshotTest-1721308478 None] Acquiring lock "cinder-quobyte-10ab285a-f425-4be2-a07a-c6d20160739b" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:20 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d5b159e1-0629-44fa-8e10-298ed9dc967e tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "cinder-quobyte-10ab285a-f425-4be2-a07a-c6d20160739b" acquired by "delete_volume" :: waited 0.042s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:20 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16e1015-5963-47ea-84fc-6ba4f9887085]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:20:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d5b159e1-0629-44fa-8e10-298ed9dc967e tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-10ab285a-f425-4be2-a07a-c6d20160739b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:20 devstack sudo[101169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-10ab285a-f425-4be2-a07a-c6d20160739b Nov 03 13:20:20 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:21 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d5b159e1-0629-44fa-8e10-298ed9dc967e tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-10ab285a-f425-4be2-a07a-c6d20160739b" returned: 0 in 0.826s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d5b159e1-0629-44fa-8e10-298ed9dc967e tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-10ab285a-f425-4be2-a07a-c6d20160739b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:21 devstack sudo[101180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-10ab285a-f425-4be2-a07a-c6d20160739b Nov 03 13:20:21 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:21 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d5b159e1-0629-44fa-8e10-298ed9dc967e tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-10ab285a-f425-4be2-a07a-c6d20160739b" returned: 0 in 0.458s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:21 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d5b159e1-0629-44fa-8e10-298ed9dc967e tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "cinder-quobyte-10ab285a-f425-4be2-a07a-c6d20160739b" released by "delete_volume" :: held 1.418s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:20:22 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-d5b159e1-0629-44fa-8e10-298ed9dc967e tempest-CreateVolumesFromSnapshotTest-1721308478 None] Created reservations ['4ea8bc48-835c-4381-af4d-10c8ad6c1c89', 'c4ae04df-e7bb-4a17-9cc9-bbda65cb14e9', '5034e72a-cafd-4530-85db-fee076572b43', '6e3df3b5-95ff-4f23-ba6d-486848d3e483'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:20:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d5b159e1-0629-44fa-8e10-298ed9dc967e tempest-CreateVolumesFromSnapshotTest-1721308478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d5b159e1-0629-44fa-8e10-298ed9dc967e tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:22 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d5b159e1-0629-44fa-8e10-298ed9dc967e tempest-CreateVolumesFromSnapshotTest-1721308478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:20:22 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d5b159e1-0629-44fa-8e10-298ed9dc967e tempest-CreateVolumesFromSnapshotTest-1721308478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:20:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d5b159e1-0629-44fa-8e10-298ed9dc967e tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d5b159e1-0629-44fa-8e10-298ed9dc967e tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:22 devstack sudo[101184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:20:22 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:22 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d5b159e1-0629-44fa-8e10-298ed9dc967e tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.688s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:22 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-d5b159e1-0629-44fa-8e10-298ed9dc967e tempest-CreateVolumesFromSnapshotTest-1721308478 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:20:22 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-d5b159e1-0629-44fa-8e10-298ed9dc967e tempest-CreateVolumesFromSnapshotTest-1721308478 None] Deleted volume successfully. Nov 03 13:20:23 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b171f17e-0755-4413-afe3-b139a64df90a tempest-CreateVolumesFromSnapshotTest-1721308478 None] Acquiring lock "cinder-d567db95-54ef-4cb3-bf38-e3d57da7574e-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:23 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d5b159e1-0629-44fa-8e10-298ed9dc967e tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "cinder-10ab285a-f425-4be2-a07a-c6d20160739b-delete_volume" released by "delete_volume" :: held 2.697s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:20:23 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b171f17e-0755-4413-afe3-b139a64df90a tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "cinder-d567db95-54ef-4cb3-bf38-e3d57da7574e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:23 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b171f17e-0755-4413-afe3-b139a64df90a tempest-CreateVolumesFromSnapshotTest-1721308478 None] Acquiring lock "cinder-quobyte-d567db95-54ef-4cb3-bf38-e3d57da7574e" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:23 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b171f17e-0755-4413-afe3-b139a64df90a tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "cinder-quobyte-d567db95-54ef-4cb3-bf38-e3d57da7574e" acquired by "delete_volume" :: waited 0.113s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:23 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26b2192-3aa0-4522-aef7-6f750000e162]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:20:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b171f17e-0755-4413-afe3-b139a64df90a tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d567db95-54ef-4cb3-bf38-e3d57da7574e {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:23 devstack sudo[101225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d567db95-54ef-4cb3-bf38-e3d57da7574e Nov 03 13:20:23 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:24 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b171f17e-0755-4413-afe3-b139a64df90a tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d567db95-54ef-4cb3-bf38-e3d57da7574e" returned: 0 in 0.958s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b171f17e-0755-4413-afe3-b139a64df90a tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d567db95-54ef-4cb3-bf38-e3d57da7574e {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:24 devstack sudo[101231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d567db95-54ef-4cb3-bf38-e3d57da7574e Nov 03 13:20:24 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:25 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b171f17e-0755-4413-afe3-b139a64df90a tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-d567db95-54ef-4cb3-bf38-e3d57da7574e" returned: 0 in 0.961s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b171f17e-0755-4413-afe3-b139a64df90a tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "cinder-quobyte-d567db95-54ef-4cb3-bf38-e3d57da7574e" released by "delete_volume" :: held 2.098s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:20:25 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-b171f17e-0755-4413-afe3-b139a64df90a tempest-CreateVolumesFromSnapshotTest-1721308478 None] Created reservations ['5a3e120f-0aff-42d2-9f14-e961c59dd949', '0c98aedc-42cb-4b42-ab40-360511cdadf3', '817f13d0-c25d-4e30-9984-59daaae10944', 'aad81233-31ad-46fd-90bb-0d5ccf1db026'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:20:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b171f17e-0755-4413-afe3-b139a64df90a tempest-CreateVolumesFromSnapshotTest-1721308478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b171f17e-0755-4413-afe3-b139a64df90a tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b171f17e-0755-4413-afe3-b139a64df90a tempest-CreateVolumesFromSnapshotTest-1721308478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:20:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b171f17e-0755-4413-afe3-b139a64df90a tempest-CreateVolumesFromSnapshotTest-1721308478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:20:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b171f17e-0755-4413-afe3-b139a64df90a tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b171f17e-0755-4413-afe3-b139a64df90a tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:25 devstack sudo[101237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:20:25 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:26 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b171f17e-0755-4413-afe3-b139a64df90a tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.614s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:26 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-b171f17e-0755-4413-afe3-b139a64df90a tempest-CreateVolumesFromSnapshotTest-1721308478 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:20:26 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-b171f17e-0755-4413-afe3-b139a64df90a tempest-CreateVolumesFromSnapshotTest-1721308478 None] Deleted volume successfully. Nov 03 13:20:26 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b171f17e-0755-4413-afe3-b139a64df90a tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "cinder-d567db95-54ef-4cb3-bf38-e3d57da7574e-delete_volume" released by "delete_volume" :: held 3.468s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:20:26 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-efc5ca0d-b839-44f5-8f51-4a145a8371a4 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Acquiring lock "cinder-0072973b-1e3c-408d-b28d-77a177da82e2-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:26 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-efc5ca0d-b839-44f5-8f51-4a145a8371a4 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "cinder-0072973b-1e3c-408d-b28d-77a177da82e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:26 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-efc5ca0d-b839-44f5-8f51-4a145a8371a4 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Acquiring lock "cinder-quobyte-2aacdffe-af21-447a-9eb3-49866d5e7eb0" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:27 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-efc5ca0d-b839-44f5-8f51-4a145a8371a4 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "cinder-quobyte-2aacdffe-af21-447a-9eb3-49866d5e7eb0" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:27 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-efc5ca0d-b839-44f5-8f51-4a145a8371a4 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Acquiring lock "cinder-quobyte-0072973b-1e3c-408d-b28d-77a177da82e2" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:27 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-efc5ca0d-b839-44f5-8f51-4a145a8371a4 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "cinder-quobyte-0072973b-1e3c-408d-b28d-77a177da82e2" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:27 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-efc5ca0d-b839-44f5-8f51-4a145a8371a4 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Deleting offline snapshot 0072973b-1e3c-408d-b28d-77a177da82e2 of volume 2aacdffe-af21-447a-9eb3-49866d5e7eb0 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:20:27 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:27 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-efc5ca0d-b839-44f5-8f51-4a145a8371a4 tempest-CreateVolumesFromSnapshotTest-1721308478 None] snapshot_file for this snap is: volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0.0072973b-1e3c-408d-b28d-77a177da82e2 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:20:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5fe549b9-6a6d-4ba1-aca4-a4c668a3c800" returned: 0 in 12.183s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:27 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616, size 1024.00 MB, duration 12.18 sec, destination /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5fe549b9-6a6d-4ba1-aca4-a4c668a3c800 {{(pid=86725) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:20:27 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Converted 1024.00 MB image at 84.04 MB/s Nov 03 13:20:27 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5fe549b9-6a6d-4ba1-aca4-a4c668a3c800 is being set with open permissions: ugo+rw Nov 03 13:20:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5fe549b9-6a6d-4ba1-aca4-a4c668a3c800 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:27 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ba351c-a4ad-49b3-b905-9d95128366e2]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:20:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-efc5ca0d-b839-44f5-8f51-4a145a8371a4 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0.0072973b-1e3c-408d-b28d-77a177da82e2 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:27 devstack sudo[101241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5fe549b9-6a6d-4ba1-aca4-a4c668a3c800 Nov 03 13:20:27 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:27 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0.0072973b-1e3c-408d-b28d-77a177da82e2 Nov 03 13:20:27 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:27 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5fe549b9-6a6d-4ba1-aca4-a4c668a3c800" returned: 0 in 0.462s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:27 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Lock "cinder-quobyte-5fe549b9-6a6d-4ba1-aca4-a4c668a3c800" released by "_copy_volume_from_snapshot" :: held 13.961s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:20:27 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Lock "cinder-quobyte-0b760a85-4429-4311-8437-415298b66e97-5fe549b9-6a6d-4ba1-aca4-a4c668a3c800" released by "_create_volume_from_snapshot" :: held 14.079s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:20:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.114s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb35753f-8912-4034-acf8-a06684abd0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fe549b9-6a6d-4ba1-aca4-a4c668a3c800', 'volume_size': 1, 'snapshot_id': '0b760a85-4429-4311-8437-415298b66e97'}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a0fa5f-b14c-40b6-a6b5-1f86ba9bef67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:27 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Volume volume-5fe549b9-6a6d-4ba1-aca4-a4c668a3c800 (5fe549b9-6a6d-4ba1-aca4-a4c668a3c800): created successfully Nov 03 13:20:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a0fa5f-b14c-40b6-a6b5-1f86ba9bef67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Flow 'volume_create_manager' (06370418-90ff-4fa0-8733-349c580de770) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:20:27 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-2f0d07f3-47e4-4409-9caf-3099e06cfd78 tempest-TestStampPattern-2136190020 None] Created volume successfully. Nov 03 13:20:27 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-efc5ca0d-b839-44f5-8f51-4a145a8371a4 tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0.0072973b-1e3c-408d-b28d-77a177da82e2" returned: 0 in 0.623s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:27 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-efc5ca0d-b839-44f5-8f51-4a145a8371a4 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:20:27 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b769c3-00a6-48a6-b2b3-61efcd6d2465]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:20:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-efc5ca0d-b839-44f5-8f51-4a145a8371a4 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:28 devstack sudo[101256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0 Nov 03 13:20:28 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:28 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-efc5ca0d-b839-44f5-8f51-4a145a8371a4 tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0" returned: 0 in 0.754s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-efc5ca0d-b839-44f5-8f51-4a145a8371a4 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0.0072973b-1e3c-408d-b28d-77a177da82e2 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:28 devstack sudo[101274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0.0072973b-1e3c-408d-b28d-77a177da82e2 Nov 03 13:20:28 devstack sudo[101274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:29 devstack sudo[101274]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-efc5ca0d-b839-44f5-8f51-4a145a8371a4 tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0.0072973b-1e3c-408d-b28d-77a177da82e2" returned: 0 in 0.579s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-efc5ca0d-b839-44f5-8f51-4a145a8371a4 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0.0072973b-1e3c-408d-b28d-77a177da82e2 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:29 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0.0072973b-1e3c-408d-b28d-77a177da82e2 Nov 03 13:20:29 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:29 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-efc5ca0d-b839-44f5-8f51-4a145a8371a4 tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0.0072973b-1e3c-408d-b28d-77a177da82e2" returned: 0 in 0.334s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:29 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-efc5ca0d-b839-44f5-8f51-4a145a8371a4 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "cinder-quobyte-0072973b-1e3c-408d-b28d-77a177da82e2" released by "_delete_snapshot" :: held 2.503s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:20:29 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-efc5ca0d-b839-44f5-8f51-4a145a8371a4 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "cinder-quobyte-2aacdffe-af21-447a-9eb3-49866d5e7eb0" released by "delete_snapshot" :: held 2.551s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:20:29 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-efc5ca0d-b839-44f5-8f51-4a145a8371a4 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Created reservations ['7e3149ca-f11f-4a59-8eec-ac8f384c2ddf', '7a924796-5409-4481-a80d-a32d88a88d33', '7d45fc18-c872-4255-b3f6-1242ac41913f', '7eb40572-7984-4db2-af52-3eda1523296a'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:20:29 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-efc5ca0d-b839-44f5-8f51-4a145a8371a4 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Delete snapshot completed successfully. Nov 03 13:20:29 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-efc5ca0d-b839-44f5-8f51-4a145a8371a4 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "cinder-0072973b-1e3c-408d-b28d-77a177da82e2-delete_snapshot" released by "delete_snapshot" :: held 2.740s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:20:30 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a668fdf4-5ed7-49bd-84f3-0d3c397dcaf2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Acquiring lock "cinder-2aacdffe-af21-447a-9eb3-49866d5e7eb0-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:30 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a668fdf4-5ed7-49bd-84f3-0d3c397dcaf2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "cinder-2aacdffe-af21-447a-9eb3-49866d5e7eb0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:30 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a668fdf4-5ed7-49bd-84f3-0d3c397dcaf2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Acquiring lock "cinder-quobyte-2aacdffe-af21-447a-9eb3-49866d5e7eb0" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:30 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a668fdf4-5ed7-49bd-84f3-0d3c397dcaf2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "cinder-quobyte-2aacdffe-af21-447a-9eb3-49866d5e7eb0" acquired by "delete_volume" :: waited 0.029s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:30 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[42119b03-2541-4a61-beca-1514ebccb143]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:20:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a668fdf4-5ed7-49bd-84f3-0d3c397dcaf2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:30 devstack sudo[101283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0 Nov 03 13:20:30 devstack sudo[101283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:30 devstack sudo[101283]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a668fdf4-5ed7-49bd-84f3-0d3c397dcaf2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0" returned: 0 in 0.475s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a668fdf4-5ed7-49bd-84f3-0d3c397dcaf2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:30 devstack sudo[101288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0 Nov 03 13:20:30 devstack sudo[101288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:31 devstack sudo[101288]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a668fdf4-5ed7-49bd-84f3-0d3c397dcaf2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2aacdffe-af21-447a-9eb3-49866d5e7eb0" returned: 0 in 0.291s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:31 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a668fdf4-5ed7-49bd-84f3-0d3c397dcaf2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "cinder-quobyte-2aacdffe-af21-447a-9eb3-49866d5e7eb0" released by "delete_volume" :: held 0.858s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:20:31 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-a668fdf4-5ed7-49bd-84f3-0d3c397dcaf2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Created reservations ['1dfdb31b-458c-469f-98c9-c6fcaa57ba5b', '30aa4d70-801a-4eef-a3c7-37618a241b43', '52529c09-ead4-4195-814f-b7207f72f27c', 'b8e72c41-6bff-4dd3-a389-ba6a2c5b123d'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:20:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a668fdf4-5ed7-49bd-84f3-0d3c397dcaf2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a668fdf4-5ed7-49bd-84f3-0d3c397dcaf2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:31 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a668fdf4-5ed7-49bd-84f3-0d3c397dcaf2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:20:31 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a668fdf4-5ed7-49bd-84f3-0d3c397dcaf2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:20:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a668fdf4-5ed7-49bd-84f3-0d3c397dcaf2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a668fdf4-5ed7-49bd-84f3-0d3c397dcaf2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:31 devstack sudo[101291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:20:31 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:31 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a668fdf4-5ed7-49bd-84f3-0d3c397dcaf2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.399s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:31 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-a668fdf4-5ed7-49bd-84f3-0d3c397dcaf2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:20:31 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-a668fdf4-5ed7-49bd-84f3-0d3c397dcaf2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Deleted volume successfully. Nov 03 13:20:31 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a668fdf4-5ed7-49bd-84f3-0d3c397dcaf2 tempest-CreateVolumesFromSnapshotTest-1721308478 None] Lock "cinder-2aacdffe-af21-447a-9eb3-49866d5e7eb0-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:20:35 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:20:35 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] Flow 'volume_create_manager' (e8de43aa-fd1e-4419-875e-b1424618b53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:20:35 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d1956bb-8b2b-48d2-8421-ae62413459d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:35 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d1956bb-8b2b-48d2-8421-ae62413459d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-654276010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99ba1788-d5c7-4eeb-ad12-ba5556833965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b8420d5761474bb78a4bbd6533d309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:20:36Z,use_quota=True,user_id='d93944011db647bea6b88b4cff1282dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:35 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b6dbfae-69cf-469d-bc71-966cdf524ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:35 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b6dbfae-69cf-469d-bc71-966cdf524ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:35 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (342c4b6e-4484-4367-b1d8-535813850d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:35 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (342c4b6e-4484-4367-b1d8-535813850d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99ba1788-d5c7-4eeb-ad12-ba5556833965', 'volume_name': 'volume-99ba1788-d5c7-4eeb-ad12-ba5556833965', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:35 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee2b94c-ca43-4fcc-b6f5-2f23127b2882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:35 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee2b94c-ca43-4fcc-b6f5-2f23127b2882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:35 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be0064e6-d3f3-4376-8849-b0b585d4aeb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:35 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] Volume 99ba1788-d5c7-4eeb-ad12-ba5556833965: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99ba1788-d5c7-4eeb-ad12-ba5556833965', 'volume_size': 1} Nov 03 13:20:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:35 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-654276010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99ba1788-d5c7-4eeb-ad12-ba5556833965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b8420d5761474bb78a4bbd6533d309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:20:36Z,use_quota=True,user_id='d93944011db647bea6b88b4cff1282dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:20:35 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] Creating volume 99ba1788-d5c7-4eeb-ad12-ba5556833965 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:20:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:35 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:20:35 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:20:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:35 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:20:35 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:20:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:35 devstack sudo[101297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965 1073741824 Nov 03 13:20:35 devstack sudo[101297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:36 devstack sudo[101297]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965 1073741824" returned: 0 in 0.502s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:36 devstack sudo[101303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965 Nov 03 13:20:36 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:36 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965" returned: 0 in 0.326s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:20:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be0064e6-d3f3-4376-8849-b0b585d4aeb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99ba1788-d5c7-4eeb-ad12-ba5556833965', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0a0fc4a-5aec-4ac9-9807-2f2a22df072d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:36 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] Volume volume-99ba1788-d5c7-4eeb-ad12-ba5556833965 (99ba1788-d5c7-4eeb-ad12-ba5556833965): created successfully Nov 03 13:20:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0a0fc4a-5aec-4ac9-9807-2f2a22df072d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] Flow 'volume_create_manager' (e8de43aa-fd1e-4419-875e-b1424618b53f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:20:36 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-0bd29ff5-8872-4db8-81cc-ce531c1ad126 tempest-VolumeDependencyTests-1266657538 None] Created volume successfully. Nov 03 13:20:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8139b6fd-3389-46ff-a6fa-4d923d08681f tempest-VolumeDependencyTests-1266657538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8139b6fd-3389-46ff-a6fa-4d923d08681f tempest-VolumeDependencyTests-1266657538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:37 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-8139b6fd-3389-46ff-a6fa-4d923d08681f tempest-VolumeDependencyTests-1266657538 None] Creating offline snapshot c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80 of volume 99ba1788-d5c7-4eeb-ad12-ba5556833965 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:20:38 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8821f4-91c2-4fda-8e52-512fe1ebe1fe]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:20:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8139b6fd-3389-46ff-a6fa-4d923d08681f tempest-VolumeDependencyTests-1266657538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:38 devstack sudo[101316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965 Nov 03 13:20:38 devstack sudo[101316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:38 devstack sudo[101316]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8139b6fd-3389-46ff-a6fa-4d923d08681f tempest-VolumeDependencyTests-1266657538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965" returned: 0 in 0.418s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8139b6fd-3389-46ff-a6fa-4d923d08681f tempest-VolumeDependencyTests-1266657538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965.c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:38 devstack sudo[101324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965.c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80 1G Nov 03 13:20:38 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:38 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8139b6fd-3389-46ff-a6fa-4d923d08681f tempest-VolumeDependencyTests-1266657538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965.c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80 1G" returned: 0 in 0.415s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8139b6fd-3389-46ff-a6fa-4d923d08681f tempest-VolumeDependencyTests-1266657538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99ba1788-d5c7-4eeb-ad12-ba5556833965 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965.c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:38 devstack sudo[101330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99ba1788-d5c7-4eeb-ad12-ba5556833965 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965.c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80 Nov 03 13:20:38 devstack sudo[101330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:39 devstack sudo[101330]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8139b6fd-3389-46ff-a6fa-4d923d08681f tempest-VolumeDependencyTests-1266657538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99ba1788-d5c7-4eeb-ad12-ba5556833965 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965.c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80" returned: 0 in 0.324s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:39 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-8139b6fd-3389-46ff-a6fa-4d923d08681f tempest-VolumeDependencyTests-1266657538 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965.c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80 is being set with open permissions: ugo+rw Nov 03 13:20:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8139b6fd-3389-46ff-a6fa-4d923d08681f tempest-VolumeDependencyTests-1266657538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965.c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:39 devstack sudo[101335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965.c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80 Nov 03 13:20:39 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:39 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8139b6fd-3389-46ff-a6fa-4d923d08681f tempest-VolumeDependencyTests-1266657538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965.c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80" returned: 0 in 0.278s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8139b6fd-3389-46ff-a6fa-4d923d08681f tempest-VolumeDependencyTests-1266657538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:39 devstack sudo[101338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965.info Nov 03 13:20:39 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:39 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8139b6fd-3389-46ff-a6fa-4d923d08681f tempest-VolumeDependencyTests-1266657538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965.info" returned: 0 in 0.261s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:39 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-8139b6fd-3389-46ff-a6fa-4d923d08681f tempest-VolumeDependencyTests-1266657538 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965.info is being set with open permissions: ugo+rw Nov 03 13:20:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8139b6fd-3389-46ff-a6fa-4d923d08681f tempest-VolumeDependencyTests-1266657538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:39 devstack sudo[101341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965.info Nov 03 13:20:39 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:40 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8139b6fd-3389-46ff-a6fa-4d923d08681f tempest-VolumeDependencyTests-1266657538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965.info" returned: 0 in 0.253s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8139b6fd-3389-46ff-a6fa-4d923d08681f tempest-VolumeDependencyTests-1266657538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.101s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:40 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-8139b6fd-3389-46ff-a6fa-4d923d08681f tempest-VolumeDependencyTests-1266657538 None] Create snapshot completed successfully Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Flow 'volume_create_manager' (e4683b47-010e-405d-82dd-a5b9852a1b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cdfd16e-5322-4c6a-8983-f3e2a72ed952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cdfd16e-5322-4c6a-8983-f3e2a72ed952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1655278373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3450a7fc-9d7d-4d4f-81a4-e838d1a8356b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b8420d5761474bb78a4bbd6533d309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:20:42Z,use_quota=True,user_id='d93944011db647bea6b88b4cff1282dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ad2687a-87c1-43a7-b322-4bb1d690d14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ad2687a-87c1-43a7-b322-4bb1d690d14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (015b4c40-44da-48f9-89df-1b1c4020e50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (015b4c40-44da-48f9-89df-1b1c4020e50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3450a7fc-9d7d-4d4f-81a4-e838d1a8356b', 'volume_name': 'volume-3450a7fc-9d7d-4d4f-81a4-e838d1a8356b', 'volume_size': 1, 'snapshot_id': 'c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80'}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf6f7a58-1d71-45c3-b8ef-574f3607bba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf6f7a58-1d71-45c3-b8ef-574f3607bba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13a04818-4005-4db9-a202-1bf7534ecb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:41 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Volume 3450a7fc-9d7d-4d4f-81a4-e838d1a8356b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3450a7fc-9d7d-4d4f-81a4-e838d1a8356b', 'volume_size': 1, 'snapshot_id': 'c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80'} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Acquiring lock "cinder-quobyte-c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80-3450a7fc-9d7d-4d4f-81a4-e838d1a8356b" by "_create_volume_from_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] Flow 'volume_create_manager' (34ac6c70-9e94-49ce-b7b5-b6a12cf6dbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64407cde-157a-46d9-9ec3-a5d9f9dc3852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Lock "cinder-quobyte-c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80-3450a7fc-9d7d-4d4f-81a4-e838d1a8356b" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Creating volume 3450a7fc-9d7d-4d4f-81a4-e838d1a8356b from snapshot c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80 {{(pid=86725) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Acquiring lock "cinder-quobyte-3450a7fc-9d7d-4d4f-81a4-e838d1a8356b" by "_copy_volume_from_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64407cde-157a-46d9-9ec3-a5d9f9dc3852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1771402318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9c156eb-776b-4b1d-93fe-195c6c3e7c9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e743254e9384d179a73e986148d8b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:20:42Z,use_quota=True,user_id='82f40b128c3a4f7a89c9bfd5235cddbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a873ce8-05e3-4af5-ac6f-57d0315d4243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a873ce8-05e3-4af5-ac6f-57d0315d4243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (631d91d7-2d2e-4540-af9d-25c1ba4b6bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (631d91d7-2d2e-4540-af9d-25c1ba4b6bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9c156eb-776b-4b1d-93fe-195c6c3e7c9c', 'volume_name': 'volume-a9c156eb-776b-4b1d-93fe-195c6c3e7c9c', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac369e71-4adf-4d5c-9231-8d1754ff16d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac369e71-4adf-4d5c-9231-8d1754ff16d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80e1a483-885c-444c-b461-4aace69f95ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:41 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] Volume a9c156eb-776b-4b1d-93fe-195c6c3e7c9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9c156eb-776b-4b1d-93fe-195c6c3e7c9c', 'volume_size': 1} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Lock "cinder-quobyte-3450a7fc-9d7d-4d4f-81a4-e838d1a8356b" acquired by "_copy_volume_from_snapshot" :: waited 0.055s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:41 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] snapshot: c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80, volume: 3450a7fc-9d7d-4d4f-81a4-e838d1a8356b, {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 13:20:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:42 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:20:42 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:20:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:42 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3f608e-4324-4655-802b-594fdf90bc5d]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:20:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965.c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:42 devstack sudo[101345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965.c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80 Nov 03 13:20:42 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:42 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965.c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80" returned: 0 in 0.363s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:42 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99ba1788-d5c7-4eeb-ad12-ba5556833965(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:20:42 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bddb97-cc54-4c98-b684-631f7622bcfe]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:20:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:42 devstack sudo[101350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965 Nov 03 13:20:42 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:42 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965" returned: 0 in 0.349s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:42 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965 {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 13:20:42 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Creating direct copy from snapshot {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 13:20:42 devstack cinder-volume[86725]: DEBUG cinder.utils [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Path /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3450a7fc-9d7d-4d4f-81a4-e838d1a8356b not found in is_blk_device check {{(pid=86725) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 13:20:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3450a7fc-9d7d-4d4f-81a4-e838d1a8356b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:42 devstack sudo[101355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3450a7fc-9d7d-4d4f-81a4-e838d1a8356b Nov 03 13:20:42 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:48 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3450a7fc-9d7d-4d4f-81a4-e838d1a8356b" returned: 0 in 6.221s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:48 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965, size 1024.00 MB, duration 6.22 sec, destination /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3450a7fc-9d7d-4d4f-81a4-e838d1a8356b {{(pid=86725) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:20:48 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Converted 1024.00 MB image at 164.57 MB/s Nov 03 13:20:48 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3450a7fc-9d7d-4d4f-81a4-e838d1a8356b is being set with open permissions: ugo+rw Nov 03 13:20:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3450a7fc-9d7d-4d4f-81a4-e838d1a8356b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:49 devstack sudo[101406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3450a7fc-9d7d-4d4f-81a4-e838d1a8356b Nov 03 13:20:49 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:49 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3450a7fc-9d7d-4d4f-81a4-e838d1a8356b" returned: 0 in 0.312s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:49 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Lock "cinder-quobyte-3450a7fc-9d7d-4d4f-81a4-e838d1a8356b" released by "_copy_volume_from_snapshot" :: held 7.325s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:20:49 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=140,cinder:INSERT=31,cinder:UPDATE=151,cinder:DELETE=13 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:20:49 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=119,cinder:UPDATE=179,cinder:DELETE=18,cinder:INSERT=45 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:20:49 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Lock "cinder-quobyte-c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80-3450a7fc-9d7d-4d4f-81a4-e838d1a8356b" released by "_create_volume_from_snapshot" :: held 7.446s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:20:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.493s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.387s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1771402318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9c156eb-776b-4b1d-93fe-195c6c3e7c9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e743254e9384d179a73e986148d8b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:20:42Z,use_quota=True,user_id='82f40b128c3a4f7a89c9bfd5235cddbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:20:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] Creating volume a9c156eb-776b-4b1d-93fe-195c6c3e7c9c {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:20:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:20:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:20:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:20:49 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:20:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a9c156eb-776b-4b1d-93fe-195c6c3e7c9c 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:49 devstack sudo[101409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a9c156eb-776b-4b1d-93fe-195c6c3e7c9c 1073741824 Nov 03 13:20:49 devstack sudo[101409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13a04818-4005-4db9-a202-1bf7534ecb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3450a7fc-9d7d-4d4f-81a4-e838d1a8356b', 'volume_size': 1, 'snapshot_id': 'c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80'}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d88b0118-720b-48bc-bb9c-0341a8230b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:49 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Volume volume-3450a7fc-9d7d-4d4f-81a4-e838d1a8356b (3450a7fc-9d7d-4d4f-81a4-e838d1a8356b): created successfully Nov 03 13:20:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d88b0118-720b-48bc-bb9c-0341a8230b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Flow 'volume_create_manager' (e4683b47-010e-405d-82dd-a5b9852a1b64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:20:49 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-0b58146c-ad46-4e9b-a8f1-e146c56e5563 tempest-VolumeDependencyTests-1266657538 None] Created volume successfully. Nov 03 13:20:49 devstack sudo[101409]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a9c156eb-776b-4b1d-93fe-195c6c3e7c9c 1073741824" returned: 0 in 0.445s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a9c156eb-776b-4b1d-93fe-195c6c3e7c9c {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:49 devstack sudo[101415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a9c156eb-776b-4b1d-93fe-195c6c3e7c9c Nov 03 13:20:49 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:50 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a9c156eb-776b-4b1d-93fe-195c6c3e7c9c" returned: 0 in 0.246s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80e1a483-885c-444c-b461-4aace69f95ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9c156eb-776b-4b1d-93fe-195c6c3e7c9c', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d29c817-8a57-4a8c-9ade-ccda47c59558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:50 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] Volume volume-a9c156eb-776b-4b1d-93fe-195c6c3e7c9c (a9c156eb-776b-4b1d-93fe-195c6c3e7c9c): created successfully Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d29c817-8a57-4a8c-9ade-ccda47c59558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] Flow 'volume_create_manager' (34ac6c70-9e94-49ce-b7b5-b6a12cf6dbc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:20:50 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-b3e97e33-8917-49b0-b4e4-fc24514dca05 tempest-VolumesListAdminTestJSON-1089775871 None] Created volume successfully. Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-ff9794ff-0fe0-4c48-8312-b514160ea5e8 tempest-VolumeDependencyTests-1266657538 None] Acquiring lock "cinder-c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-ff9794ff-0fe0-4c48-8312-b514160ea5e8 tempest-VolumeDependencyTests-1266657538 None] Lock "cinder-c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-ff9794ff-0fe0-4c48-8312-b514160ea5e8 tempest-VolumeDependencyTests-1266657538 None] Acquiring lock "cinder-quobyte-99ba1788-d5c7-4eeb-ad12-ba5556833965" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-ff9794ff-0fe0-4c48-8312-b514160ea5e8 tempest-VolumeDependencyTests-1266657538 None] Lock "cinder-quobyte-99ba1788-d5c7-4eeb-ad12-ba5556833965" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-ff9794ff-0fe0-4c48-8312-b514160ea5e8 tempest-VolumeDependencyTests-1266657538 None] Acquiring lock "cinder-quobyte-c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-ff9794ff-0fe0-4c48-8312-b514160ea5e8 tempest-VolumeDependencyTests-1266657538 None] Lock "cinder-quobyte-c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-ff9794ff-0fe0-4c48-8312-b514160ea5e8 tempest-VolumeDependencyTests-1266657538 None] Deleting offline snapshot c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80 of volume 99ba1788-d5c7-4eeb-ad12-ba5556833965 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-ff9794ff-0fe0-4c48-8312-b514160ea5e8 tempest-VolumeDependencyTests-1266657538 None] snapshot_file for this snap is: volume-99ba1788-d5c7-4eeb-ad12-ba5556833965.c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fab51b-7d98-4d68-a47e-aeb86101aae0]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ff9794ff-0fe0-4c48-8312-b514160ea5e8 tempest-VolumeDependencyTests-1266657538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965.c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:50 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965.c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80 Nov 03 13:20:50 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:50 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ff9794ff-0fe0-4c48-8312-b514160ea5e8 tempest-VolumeDependencyTests-1266657538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965.c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80" returned: 0 in 0.389s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-ff9794ff-0fe0-4c48-8312-b514160ea5e8 tempest-VolumeDependencyTests-1266657538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99ba1788-d5c7-4eeb-ad12-ba5556833965(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f312643-cef7-43d6-94d5-a2b9472a4afd]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ff9794ff-0fe0-4c48-8312-b514160ea5e8 tempest-VolumeDependencyTests-1266657538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] Flow 'volume_create_manager' (c020a6a0-0d77-42d4-9d07-392f975d78e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a0a103b-8879-474b-aa2d-ef7bff46f100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:50 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965 Nov 03 13:20:50 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a0a103b-8879-474b-aa2d-ef7bff46f100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1048103422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9124626a-1905-4560-a6ed-6d36b5491309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e743254e9384d179a73e986148d8b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:20:51Z,use_quota=True,user_id='82f40b128c3a4f7a89c9bfd5235cddbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8517ab03-926b-47a9-968b-cf2aed10a74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8517ab03-926b-47a9-968b-cf2aed10a74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d725cc8-522a-4805-8ee0-88d505aa7e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d725cc8-522a-4805-8ee0-88d505aa7e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9124626a-1905-4560-a6ed-6d36b5491309', 'volume_name': 'volume-9124626a-1905-4560-a6ed-6d36b5491309', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3c6b135-133a-49dc-aa9d-f6d575d4fc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3c6b135-133a-49dc-aa9d-f6d575d4fc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ff6c19-a2b2-418c-842c-d81836682f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:50 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] Volume 9124626a-1905-4560-a6ed-6d36b5491309: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9124626a-1905-4560-a6ed-6d36b5491309', 'volume_size': 1} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1048103422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9124626a-1905-4560-a6ed-6d36b5491309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e743254e9384d179a73e986148d8b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:20:51Z,use_quota=True,user_id='82f40b128c3a4f7a89c9bfd5235cddbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] Creating volume 9124626a-1905-4560-a6ed-6d36b5491309 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:20:50 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:20:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9124626a-1905-4560-a6ed-6d36b5491309 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:51 devstack sudo[101425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9124626a-1905-4560-a6ed-6d36b5491309 1073741824 Nov 03 13:20:51 devstack sudo[101425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:51 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ff9794ff-0fe0-4c48-8312-b514160ea5e8 tempest-VolumeDependencyTests-1266657538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965" returned: 0 in 0.528s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ff9794ff-0fe0-4c48-8312-b514160ea5e8 tempest-VolumeDependencyTests-1266657538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965.c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:51 devstack sudo[101433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965.c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80 Nov 03 13:20:51 devstack sudo[101433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:51 devstack sudo[101425]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9124626a-1905-4560-a6ed-6d36b5491309 1073741824" returned: 0 in 0.470s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9124626a-1905-4560-a6ed-6d36b5491309 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:51 devstack sudo[101436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9124626a-1905-4560-a6ed-6d36b5491309 Nov 03 13:20:51 devstack sudo[101436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:51 devstack sudo[101433]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ff9794ff-0fe0-4c48-8312-b514160ea5e8 tempest-VolumeDependencyTests-1266657538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965.c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80" returned: 0 in 0.341s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ff9794ff-0fe0-4c48-8312-b514160ea5e8 tempest-VolumeDependencyTests-1266657538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965.c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:51 devstack sudo[101442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965.c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80 Nov 03 13:20:51 devstack sudo[101442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:51 devstack sudo[101436]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9124626a-1905-4560-a6ed-6d36b5491309" returned: 0 in 0.253s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:20:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ff6c19-a2b2-418c-842c-d81836682f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9124626a-1905-4560-a6ed-6d36b5491309', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cef47634-9c08-4ddf-89cb-02e465a0fdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:51 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] Volume volume-9124626a-1905-4560-a6ed-6d36b5491309 (9124626a-1905-4560-a6ed-6d36b5491309): created successfully Nov 03 13:20:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cef47634-9c08-4ddf-89cb-02e465a0fdbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] Flow 'volume_create_manager' (c020a6a0-0d77-42d4-9d07-392f975d78e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:20:51 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-1f74c6ed-806b-4a36-8b97-84112a5187b2 tempest-VolumesListAdminTestJSON-1089775871 None] Created volume successfully. Nov 03 13:20:51 devstack sudo[101442]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ff9794ff-0fe0-4c48-8312-b514160ea5e8 tempest-VolumeDependencyTests-1266657538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965.c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80" returned: 0 in 0.260s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-ff9794ff-0fe0-4c48-8312-b514160ea5e8 tempest-VolumeDependencyTests-1266657538 None] Lock "cinder-quobyte-c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80" released by "_delete_snapshot" :: held 1.639s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:20:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-ff9794ff-0fe0-4c48-8312-b514160ea5e8 tempest-VolumeDependencyTests-1266657538 None] Lock "cinder-quobyte-99ba1788-d5c7-4eeb-ad12-ba5556833965" released by "delete_snapshot" :: held 1.666s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:20:52 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-ff9794ff-0fe0-4c48-8312-b514160ea5e8 tempest-VolumeDependencyTests-1266657538 None] Created reservations ['a7b8cfa4-3421-4d75-b672-45a6d68f5b26', '05906810-5dfc-4795-8ef0-8b19785fb371', '86611694-ce02-450a-8fef-5dea18ceece1', '09f195a9-1fb8-46db-96e3-348d4db1e6b7'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:20:52 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-ff9794ff-0fe0-4c48-8312-b514160ea5e8 tempest-VolumeDependencyTests-1266657538 None] Delete snapshot completed successfully. Nov 03 13:20:52 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-ff9794ff-0fe0-4c48-8312-b514160ea5e8 tempest-VolumeDependencyTests-1266657538 None] Lock "cinder-c4b71a1b-86ce-44d5-a2b8-5dc8c3edff80-delete_snapshot" released by "delete_snapshot" :: held 1.832s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:20:52 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8df73fd0-0e50-4857-9201-c4a8f5a6db45 tempest-VolumeDependencyTests-1266657538 None] Acquiring lock "cinder-99ba1788-d5c7-4eeb-ad12-ba5556833965-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:52 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8df73fd0-0e50-4857-9201-c4a8f5a6db45 tempest-VolumeDependencyTests-1266657538 None] Lock "cinder-99ba1788-d5c7-4eeb-ad12-ba5556833965-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:52 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8df73fd0-0e50-4857-9201-c4a8f5a6db45 tempest-VolumeDependencyTests-1266657538 None] Acquiring lock "cinder-quobyte-99ba1788-d5c7-4eeb-ad12-ba5556833965" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:52 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8df73fd0-0e50-4857-9201-c4a8f5a6db45 tempest-VolumeDependencyTests-1266657538 None] Lock "cinder-quobyte-99ba1788-d5c7-4eeb-ad12-ba5556833965" acquired by "delete_volume" :: waited 0.021s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:52 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3f98da-cc7f-41c4-bd51-525698dd1ec4]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:20:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8df73fd0-0e50-4857-9201-c4a8f5a6db45 tempest-VolumeDependencyTests-1266657538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:52 devstack sudo[101452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965 Nov 03 13:20:52 devstack sudo[101452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-855b6dcb-4b4d-40cf-99ec-d99f5be6f2af req-90d9fa98-a1da-49cb-8a3a-d91dc3833522 tempest-TestStampPattern-2136190020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-855b6dcb-4b4d-40cf-99ec-d99f5be6f2af req-90d9fa98-a1da-49cb-8a3a-d91dc3833522 tempest-TestStampPattern-2136190020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-855b6dcb-4b4d-40cf-99ec-d99f5be6f2af req-90d9fa98-a1da-49cb-8a3a-d91dc3833522 tempest-TestStampPattern-2136190020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-855b6dcb-4b4d-40cf-99ec-d99f5be6f2af req-90d9fa98-a1da-49cb-8a3a-d91dc3833522 tempest-TestStampPattern-2136190020 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43', 'name': 'volume-5fe549b9-6a6d-4ba1-aca4-a4c668a3c800', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8be2dbf7-1c72-4903-b389-e70b5971ab78', 'enforce_multipath': True} {{(pid=86725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:20:52 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-855b6dcb-4b4d-40cf-99ec-d99f5be6f2af req-90d9fa98-a1da-49cb-8a3a-d91dc3833522 tempest-TestStampPattern-2136190020 None] attachment_update completed successfully. Nov 03 13:20:53 devstack sudo[101452]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8df73fd0-0e50-4857-9201-c4a8f5a6db45 tempest-VolumeDependencyTests-1266657538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965" returned: 0 in 0.418s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8df73fd0-0e50-4857-9201-c4a8f5a6db45 tempest-VolumeDependencyTests-1266657538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:53 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965 Nov 03 13:20:53 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:53 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8df73fd0-0e50-4857-9201-c4a8f5a6db45 tempest-VolumeDependencyTests-1266657538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-99ba1788-d5c7-4eeb-ad12-ba5556833965" returned: 0 in 0.297s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8df73fd0-0e50-4857-9201-c4a8f5a6db45 tempest-VolumeDependencyTests-1266657538 None] Lock "cinder-quobyte-99ba1788-d5c7-4eeb-ad12-ba5556833965" released by "delete_volume" :: held 0.826s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-8df73fd0-0e50-4857-9201-c4a8f5a6db45 tempest-VolumeDependencyTests-1266657538 None] Created reservations ['51260897-42f0-4d26-9371-b25f7712bd4a', '61bef6e6-cfbf-41c1-9b98-6da35e73ff6a', 'b0ed8392-1287-47ec-b4f9-10825c8c115c', '85705b3b-1ebb-4a3c-a8a1-410296c2a775'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8df73fd0-0e50-4857-9201-c4a8f5a6db45 tempest-VolumeDependencyTests-1266657538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8df73fd0-0e50-4857-9201-c4a8f5a6db45 tempest-VolumeDependencyTests-1266657538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-8df73fd0-0e50-4857-9201-c4a8f5a6db45 tempest-VolumeDependencyTests-1266657538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-8df73fd0-0e50-4857-9201-c4a8f5a6db45 tempest-VolumeDependencyTests-1266657538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8df73fd0-0e50-4857-9201-c4a8f5a6db45 tempest-VolumeDependencyTests-1266657538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8df73fd0-0e50-4857-9201-c4a8f5a6db45 tempest-VolumeDependencyTests-1266657538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:53 devstack sudo[101885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:20:53 devstack sudo[101885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] Flow 'volume_create_manager' (626c06a3-cf2b-4dd6-92e0-e48ce1254ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35e53fbf-9cea-410c-ae7d-404a12c6a5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e655800e-864f-42e5-92b1-8c661f618eb1 tempest-VolumeDependencyTests-1266657538 None] Acquiring lock "cinder-3450a7fc-9d7d-4d4f-81a4-e838d1a8356b-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35e53fbf-9cea-410c-ae7d-404a12c6a5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1807744588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f99400-b37c-408f-b495-f9e326471861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e743254e9384d179a73e986148d8b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:20:54Z,use_quota=True,user_id='82f40b128c3a4f7a89c9bfd5235cddbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7847ad0-fe4e-4423-9298-729ac6d4203d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7847ad0-fe4e-4423-9298-729ac6d4203d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f710c158-9f1d-47da-b5c9-60ddf8334ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f710c158-9f1d-47da-b5c9-60ddf8334ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00f99400-b37c-408f-b495-f9e326471861', 'volume_name': 'volume-00f99400-b37c-408f-b495-f9e326471861', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc1ca757-3bf6-445b-8868-806471905e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc1ca757-3bf6-445b-8868-806471905e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a9418ed-1edd-4b9b-a9ef-6e428964a1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:53 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] Volume 00f99400-b37c-408f-b495-f9e326471861: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00f99400-b37c-408f-b495-f9e326471861', 'volume_size': 1} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1807744588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f99400-b37c-408f-b495-f9e326471861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e743254e9384d179a73e986148d8b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:20:54Z,use_quota=True,user_id='82f40b128c3a4f7a89c9bfd5235cddbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] Creating volume 00f99400-b37c-408f-b495-f9e326471861 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:20:53 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-00f99400-b37c-408f-b495-f9e326471861 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e655800e-864f-42e5-92b1-8c661f618eb1 tempest-VolumeDependencyTests-1266657538 None] Lock "cinder-3450a7fc-9d7d-4d4f-81a4-e838d1a8356b-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:53 devstack sudo[101888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-00f99400-b37c-408f-b495-f9e326471861 1073741824 Nov 03 13:20:53 devstack sudo[101888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e655800e-864f-42e5-92b1-8c661f618eb1 tempest-VolumeDependencyTests-1266657538 None] Acquiring lock "cinder-quobyte-3450a7fc-9d7d-4d4f-81a4-e838d1a8356b" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e655800e-864f-42e5-92b1-8c661f618eb1 tempest-VolumeDependencyTests-1266657538 None] Lock "cinder-quobyte-3450a7fc-9d7d-4d4f-81a4-e838d1a8356b" acquired by "delete_volume" :: waited 0.015s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:53 devstack sudo[101885]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8df73fd0-0e50-4857-9201-c4a8f5a6db45 tempest-VolumeDependencyTests-1266657538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.418s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-8df73fd0-0e50-4857-9201-c4a8f5a6db45 tempest-VolumeDependencyTests-1266657538 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b1c71c-5983-47df-a1c0-503fd9ec1659]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:20:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e655800e-864f-42e5-92b1-8c661f618eb1 tempest-VolumeDependencyTests-1266657538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3450a7fc-9d7d-4d4f-81a4-e838d1a8356b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:53 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-8df73fd0-0e50-4857-9201-c4a8f5a6db45 tempest-VolumeDependencyTests-1266657538 None] Deleted volume successfully. Nov 03 13:20:54 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8df73fd0-0e50-4857-9201-c4a8f5a6db45 tempest-VolumeDependencyTests-1266657538 None] Lock "cinder-99ba1788-d5c7-4eeb-ad12-ba5556833965-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:20:54 devstack sudo[101891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3450a7fc-9d7d-4d4f-81a4-e838d1a8356b Nov 03 13:20:54 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:54 devstack sudo[101888]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-00f99400-b37c-408f-b495-f9e326471861 1073741824" returned: 0 in 0.497s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-00f99400-b37c-408f-b495-f9e326471861 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:54 devstack sudo[101900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-00f99400-b37c-408f-b495-f9e326471861 Nov 03 13:20:54 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:54 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e655800e-864f-42e5-92b1-8c661f618eb1 tempest-VolumeDependencyTests-1266657538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3450a7fc-9d7d-4d4f-81a4-e838d1a8356b" returned: 0 in 0.446s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e655800e-864f-42e5-92b1-8c661f618eb1 tempest-VolumeDependencyTests-1266657538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3450a7fc-9d7d-4d4f-81a4-e838d1a8356b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:54 devstack sudo[101902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3450a7fc-9d7d-4d4f-81a4-e838d1a8356b Nov 03 13:20:54 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:54 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-00f99400-b37c-408f-b495-f9e326471861" returned: 0 in 0.253s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:54 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:20:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:54 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a9418ed-1edd-4b9b-a9ef-6e428964a1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00f99400-b37c-408f-b495-f9e326471861', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:54 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31669d25-5074-46ee-892b-c51fd3bba8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:54 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] Volume volume-00f99400-b37c-408f-b495-f9e326471861 (00f99400-b37c-408f-b495-f9e326471861): created successfully Nov 03 13:20:54 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31669d25-5074-46ee-892b-c51fd3bba8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:54 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:54 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] Flow 'volume_create_manager' (626c06a3-cf2b-4dd6-92e0-e48ce1254ba1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:20:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e655800e-864f-42e5-92b1-8c661f618eb1 tempest-VolumeDependencyTests-1266657538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3450a7fc-9d7d-4d4f-81a4-e838d1a8356b" returned: 0 in 0.257s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:54 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e655800e-864f-42e5-92b1-8c661f618eb1 tempest-VolumeDependencyTests-1266657538 None] Lock "cinder-quobyte-3450a7fc-9d7d-4d4f-81a4-e838d1a8356b" released by "delete_volume" :: held 0.762s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:20:54 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-5e7d0340-c372-4860-9720-7f52acb98e66 tempest-VolumesListAdminTestJSON-1089775871 None] Created volume successfully. Nov 03 13:20:54 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-e655800e-864f-42e5-92b1-8c661f618eb1 tempest-VolumeDependencyTests-1266657538 None] Created reservations ['65f5509f-cb35-4045-8ac0-81924ff56f04', 'a6189db6-d70d-4734-b65b-4d3025873662', '1c156694-1e53-43ea-844d-85da2d543cff', '159ec16a-545a-42c5-af8b-23fd82b626aa'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:20:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e655800e-864f-42e5-92b1-8c661f618eb1 tempest-VolumeDependencyTests-1266657538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e655800e-864f-42e5-92b1-8c661f618eb1 tempest-VolumeDependencyTests-1266657538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:54 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-e655800e-864f-42e5-92b1-8c661f618eb1 tempest-VolumeDependencyTests-1266657538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:20:54 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-e655800e-864f-42e5-92b1-8c661f618eb1 tempest-VolumeDependencyTests-1266657538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:20:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e655800e-864f-42e5-92b1-8c661f618eb1 tempest-VolumeDependencyTests-1266657538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e655800e-864f-42e5-92b1-8c661f618eb1 tempest-VolumeDependencyTests-1266657538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:54 devstack sudo[101906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:20:54 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:55 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e655800e-864f-42e5-92b1-8c661f618eb1 tempest-VolumeDependencyTests-1266657538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.276s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:55 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-e655800e-864f-42e5-92b1-8c661f618eb1 tempest-VolumeDependencyTests-1266657538 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:20:55 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-e655800e-864f-42e5-92b1-8c661f618eb1 tempest-VolumeDependencyTests-1266657538 None] Deleted volume successfully. Nov 03 13:20:55 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e655800e-864f-42e5-92b1-8c661f618eb1 tempest-VolumeDependencyTests-1266657538 None] Lock "cinder-3450a7fc-9d7d-4d4f-81a4-e838d1a8356b-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:20:56 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:20:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] Flow 'volume_create_manager' (1b456cef-614d-4089-842f-22babc3f679c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:20:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (755f95c9-b9ed-455f-b4ef-4ebc3cdfb160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (755f95c9-b9ed-455f-b4ef-4ebc3cdfb160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8008dfef-7871-44d1-9978-421985c058a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f6598adb1454570a0a28b42a44d36eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:20:57Z,use_quota=True,user_id='37737e90b51f466390ebcd195037a944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92ab20b0-b5e6-4f56-9701-a534de520122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92ab20b0-b5e6-4f56-9701-a534de520122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6281d68e-ad66-4f92-8635-81fcb1e5c5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6281d68e-ad66-4f92-8635-81fcb1e5c5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8008dfef-7871-44d1-9978-421985c058a0', 'volume_name': 'volume-8008dfef-7871-44d1-9978-421985c058a0', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8272533f-051c-4ad6-8ac7-096021e01bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8272533f-051c-4ad6-8ac7-096021e01bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb342fcd-2036-4ff6-8ee0-f486a261d882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:56 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] Volume 8008dfef-7871-44d1-9978-421985c058a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8008dfef-7871-44d1-9978-421985c058a0', 'volume_size': 1} Nov 03 13:20:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:56 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8008dfef-7871-44d1-9978-421985c058a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f6598adb1454570a0a28b42a44d36eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:20:57Z,use_quota=True,user_id='37737e90b51f466390ebcd195037a944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:20:56 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] Creating volume 8008dfef-7871-44d1-9978-421985c058a0 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:20:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:56 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:20:56 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:20:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:56 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:20:56 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:20:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8008dfef-7871-44d1-9978-421985c058a0 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:56 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8008dfef-7871-44d1-9978-421985c058a0 1073741824 Nov 03 13:20:56 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:56 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-be570dff-28a6-4a82-8e5e-5655d5ca35c2 req-3450ce78-109b-4c9d-a470-9c2e7be9b5b5 tempest-TestStampPattern-2136190020 None] Terminate volume connection completed successfully. Nov 03 13:20:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-be570dff-28a6-4a82-8e5e-5655d5ca35c2 req-3450ce78-109b-4c9d-a470-9c2e7be9b5b5 tempest-TestStampPattern-2136190020 None] Deleting attachment 8be2dbf7-1c72-4903-b389-e70b5971ab78. {{(pid=86725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:20:57 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8008dfef-7871-44d1-9978-421985c058a0 1073741824" returned: 0 in 0.537s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8008dfef-7871-44d1-9978-421985c058a0 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:57 devstack sudo[101965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8008dfef-7871-44d1-9978-421985c058a0 Nov 03 13:20:57 devstack sudo[101965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:57 devstack sudo[101965]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8008dfef-7871-44d1-9978-421985c058a0" returned: 0 in 0.305s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:57 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:20:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:57 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb342fcd-2036-4ff6-8ee0-f486a261d882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8008dfef-7871-44d1-9978-421985c058a0', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:57 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bfba705-cc5c-4283-964f-108f76042cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:20:57 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] Volume volume-8008dfef-7871-44d1-9978-421985c058a0 (8008dfef-7871-44d1-9978-421985c058a0): created successfully Nov 03 13:20:57 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bfba705-cc5c-4283-964f-108f76042cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:20:57 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] Flow 'volume_create_manager' (1b456cef-614d-4089-842f-22babc3f679c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:20:57 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-5095ca1b-8747-4c75-b727-a27e24337904 tempest-VolumesListAdminTestJSON-135950041 None] Created volume successfully. Nov 03 13:20:58 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:20:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:20:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:20:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:20:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:20:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:20:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:58 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1287c145-fe86-4111-ae94-2d7cf063732a tempest-VolumesListAdminTestJSON-135950041 None] Acquiring lock "cinder-8008dfef-7871-44d1-9978-421985c058a0-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:58 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1287c145-fe86-4111-ae94-2d7cf063732a tempest-VolumesListAdminTestJSON-135950041 None] Lock "cinder-8008dfef-7871-44d1-9978-421985c058a0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:58 devstack sudo[101980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:20:58 devstack sudo[101980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:59 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1287c145-fe86-4111-ae94-2d7cf063732a tempest-VolumesListAdminTestJSON-135950041 None] Acquiring lock "cinder-quobyte-8008dfef-7871-44d1-9978-421985c058a0" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:59 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1287c145-fe86-4111-ae94-2d7cf063732a tempest-VolumesListAdminTestJSON-135950041 None] Lock "cinder-quobyte-8008dfef-7871-44d1-9978-421985c058a0" acquired by "delete_volume" :: waited 0.050s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:59 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e70d9b-3f56-4c29-a68f-09b5f4d35f67]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:20:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1287c145-fe86-4111-ae94-2d7cf063732a tempest-VolumesListAdminTestJSON-135950041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8008dfef-7871-44d1-9978-421985c058a0 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:59 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-afcb3d7a-cdfd-4731-8688-134a62afe53f tempest-VolumesListAdminTestJSON-1089775871 None] Acquiring lock "cinder-00f99400-b37c-408f-b495-f9e326471861-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:59 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-afcb3d7a-cdfd-4731-8688-134a62afe53f tempest-VolumesListAdminTestJSON-1089775871 None] Lock "cinder-00f99400-b37c-408f-b495-f9e326471861-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:59 devstack sudo[101989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8008dfef-7871-44d1-9978-421985c058a0 Nov 03 13:20:59 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:59 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-afcb3d7a-cdfd-4731-8688-134a62afe53f tempest-VolumesListAdminTestJSON-1089775871 None] Acquiring lock "cinder-quobyte-00f99400-b37c-408f-b495-f9e326471861" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:20:59 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-afcb3d7a-cdfd-4731-8688-134a62afe53f tempest-VolumesListAdminTestJSON-1089775871 None] Lock "cinder-quobyte-00f99400-b37c-408f-b495-f9e326471861" acquired by "delete_volume" :: waited 0.025s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:20:59 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68708bc-52a1-4bdf-9a38-e8e380cf99a7]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:20:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-afcb3d7a-cdfd-4731-8688-134a62afe53f tempest-VolumesListAdminTestJSON-1089775871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-00f99400-b37c-408f-b495-f9e326471861 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:59 devstack sudo[101980]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.776s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:59 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:20:59 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager._thread_info {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:20:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread count: 28 {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:20:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread info: [<_MainThread(MainThread, started 133507074375808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:20:59 devstack sudo[101996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-00f99400-b37c-408f-b495-f9e326471861 Nov 03 13:20:59 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:20:59 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root Nov 03 13:20:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1287c145-fe86-4111-ae94-2d7cf063732a tempest-VolumesListAdminTestJSON-135950041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8008dfef-7871-44d1-9978-421985c058a0" returned: 0 in 0.669s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:20:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1287c145-fe86-4111-ae94-2d7cf063732a tempest-VolumesListAdminTestJSON-135950041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8008dfef-7871-44d1-9978-421985c058a0 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:20:59 devstack sudo[102004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8008dfef-7871-44d1-9978-421985c058a0 Nov 03 13:20:59 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:00 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-afcb3d7a-cdfd-4731-8688-134a62afe53f tempest-VolumesListAdminTestJSON-1089775871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-00f99400-b37c-408f-b495-f9e326471861" returned: 0 in 0.579s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-afcb3d7a-cdfd-4731-8688-134a62afe53f tempest-VolumesListAdminTestJSON-1089775871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-00f99400-b37c-408f-b495-f9e326471861 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:00 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-00f99400-b37c-408f-b495-f9e326471861 Nov 03 13:21:00 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:00 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1287c145-fe86-4111-ae94-2d7cf063732a tempest-VolumesListAdminTestJSON-135950041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-8008dfef-7871-44d1-9978-421985c058a0" returned: 0 in 0.420s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1287c145-fe86-4111-ae94-2d7cf063732a tempest-VolumesListAdminTestJSON-135950041 None] Lock "cinder-quobyte-8008dfef-7871-44d1-9978-421985c058a0" released by "delete_volume" :: held 1.196s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:00 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-1287c145-fe86-4111-ae94-2d7cf063732a tempest-VolumesListAdminTestJSON-135950041 None] Created reservations ['6ca37a89-8c1c-4d14-8894-c457207127b9', '232f7ecb-8029-428d-8733-9eef63c200ed', 'e3e17aa2-2a35-486b-aa24-f72c7f875df2', '3b6b7076-a741-4e8d-8f53-9b54112d8706'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:21:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1287c145-fe86-4111-ae94-2d7cf063732a tempest-VolumesListAdminTestJSON-135950041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1287c145-fe86-4111-ae94-2d7cf063732a tempest-VolumesListAdminTestJSON-135950041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:00 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1287c145-fe86-4111-ae94-2d7cf063732a tempest-VolumesListAdminTestJSON-135950041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:00 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1287c145-fe86-4111-ae94-2d7cf063732a tempest-VolumesListAdminTestJSON-135950041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1287c145-fe86-4111-ae94-2d7cf063732a tempest-VolumesListAdminTestJSON-135950041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1287c145-fe86-4111-ae94-2d7cf063732a tempest-VolumesListAdminTestJSON-135950041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:00 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-afcb3d7a-cdfd-4731-8688-134a62afe53f tempest-VolumesListAdminTestJSON-1089775871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-00f99400-b37c-408f-b495-f9e326471861" returned: 0 in 0.382s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:00 devstack sudo[102016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:21:00 devstack sudo[102016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-afcb3d7a-cdfd-4731-8688-134a62afe53f tempest-VolumesListAdminTestJSON-1089775871 None] Lock "cinder-quobyte-00f99400-b37c-408f-b495-f9e326471861" released by "delete_volume" :: held 1.086s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:00 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-afcb3d7a-cdfd-4731-8688-134a62afe53f tempest-VolumesListAdminTestJSON-1089775871 None] Created reservations ['f80fe00f-159b-4c58-b3cc-e9dee762d143', 'ea5bbb01-9b4c-40d5-88d1-0e80085c7812', '5391e5ac-d9b1-41ab-974d-9067ab04c926', '85c5fc45-0c0d-463f-913e-6c593fee44bc'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:21:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-afcb3d7a-cdfd-4731-8688-134a62afe53f tempest-VolumesListAdminTestJSON-1089775871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-afcb3d7a-cdfd-4731-8688-134a62afe53f tempest-VolumesListAdminTestJSON-1089775871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:00 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-afcb3d7a-cdfd-4731-8688-134a62afe53f tempest-VolumesListAdminTestJSON-1089775871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:00 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-afcb3d7a-cdfd-4731-8688-134a62afe53f tempest-VolumesListAdminTestJSON-1089775871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-afcb3d7a-cdfd-4731-8688-134a62afe53f tempest-VolumesListAdminTestJSON-1089775871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-afcb3d7a-cdfd-4731-8688-134a62afe53f tempest-VolumesListAdminTestJSON-1089775871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:00 devstack sudo[102019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:21:00 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:00 devstack sudo[102016]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1287c145-fe86-4111-ae94-2d7cf063732a tempest-VolumesListAdminTestJSON-135950041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.349s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:00 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-1287c145-fe86-4111-ae94-2d7cf063732a tempest-VolumesListAdminTestJSON-135950041 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:21:00 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-1287c145-fe86-4111-ae94-2d7cf063732a tempest-VolumesListAdminTestJSON-135950041 None] Deleted volume successfully. Nov 03 13:21:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1287c145-fe86-4111-ae94-2d7cf063732a tempest-VolumesListAdminTestJSON-135950041 None] Lock "cinder-8008dfef-7871-44d1-9978-421985c058a0-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:01 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-afcb3d7a-cdfd-4731-8688-134a62afe53f tempest-VolumesListAdminTestJSON-1089775871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.302s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:01 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-afcb3d7a-cdfd-4731-8688-134a62afe53f tempest-VolumesListAdminTestJSON-1089775871 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:21:01 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-afcb3d7a-cdfd-4731-8688-134a62afe53f tempest-VolumesListAdminTestJSON-1089775871 None] Deleted volume successfully. Nov 03 13:21:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-afcb3d7a-cdfd-4731-8688-134a62afe53f tempest-VolumesListAdminTestJSON-1089775871 None] Lock "cinder-00f99400-b37c-408f-b495-f9e326471861-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-132abade-ef3b-4f6a-b156-936a82b7bc25 tempest-VolumesListAdminTestJSON-1089775871 None] Acquiring lock "cinder-9124626a-1905-4560-a6ed-6d36b5491309-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-132abade-ef3b-4f6a-b156-936a82b7bc25 tempest-VolumesListAdminTestJSON-1089775871 None] Lock "cinder-9124626a-1905-4560-a6ed-6d36b5491309-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-132abade-ef3b-4f6a-b156-936a82b7bc25 tempest-VolumesListAdminTestJSON-1089775871 None] Acquiring lock "cinder-quobyte-9124626a-1905-4560-a6ed-6d36b5491309" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-132abade-ef3b-4f6a-b156-936a82b7bc25 tempest-VolumesListAdminTestJSON-1089775871 None] Lock "cinder-quobyte-9124626a-1905-4560-a6ed-6d36b5491309" acquired by "delete_volume" :: waited 0.015s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:01 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc96858-a8c7-4c7d-902d-c9301870a85b]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:21:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-132abade-ef3b-4f6a-b156-936a82b7bc25 tempest-VolumesListAdminTestJSON-1089775871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9124626a-1905-4560-a6ed-6d36b5491309 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:01 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:21:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Flow 'volume_create_manager' (f286679d-7e5b-4bba-b8c7-09581d24eacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:21:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac97788b-153d-4f61-8272-a4d043618d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac97788b-153d-4f61-8272-a4d043618d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f760f82e-ee84-4f94-ab6e-8c25ee3e7c83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d67618466b654b88a86c7ab026c267ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:21:02Z,use_quota=True,user_id='2155427026be44bcbeb6e6b6b142893c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d8dcad2-de72-430b-897e-719e07639bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d8dcad2-de72-430b-897e-719e07639bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aee6f8cc-a862-4800-ae75-9cd7f92d536f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:01 devstack cinder-volume[86725]: DEBUG cinder.image.glance [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Creating Keystone auth plugin from conf {{(pid=86725) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 13:21:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-014f7812-49a9-4e0a-8d18-9bfb10682d43 tempest-TestStampPattern-2136190020 None] Acquiring lock "cinder-5fe549b9-6a6d-4ba1-aca4-a4c668a3c800-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:01 devstack sudo[102022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9124626a-1905-4560-a6ed-6d36b5491309 Nov 03 13:21:01 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-014f7812-49a9-4e0a-8d18-9bfb10682d43 tempest-TestStampPattern-2136190020 None] Lock "cinder-5fe549b9-6a6d-4ba1-aca4-a4c668a3c800-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-014f7812-49a9-4e0a-8d18-9bfb10682d43 tempest-TestStampPattern-2136190020 None] Acquiring lock "cinder-quobyte-5fe549b9-6a6d-4ba1-aca4-a4c668a3c800" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-014f7812-49a9-4e0a-8d18-9bfb10682d43 tempest-TestStampPattern-2136190020 None] Lock "cinder-quobyte-5fe549b9-6a6d-4ba1-aca4-a4c668a3c800" acquired by "delete_volume" :: waited 0.021s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc79fa7-6733-4d35-9a3f-c0cd8e58756c]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-014f7812-49a9-4e0a-8d18-9bfb10682d43 tempest-TestStampPattern-2136190020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5fe549b9-6a6d-4ba1-aca4-a4c668a3c800 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:02 devstack sudo[102024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5fe549b9-6a6d-4ba1-aca4-a4c668a3c800 Nov 03 13:21:02 devstack sudo[102024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aee6f8cc-a862-4800-ae75-9cd7f92d536f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f760f82e-ee84-4f94-ab6e-8c25ee3e7c83', 'volume_name': 'volume-f760f82e-ee84-4f94-ab6e-8c25ee3e7c83', 'volume_size': 1, 'image_id': '04cdf2a6-bdf2-48ee-8858-99567fa09f17', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04cdf2a6-bdf2-48ee-8858-99567fa09f17', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9df613212625af1bc8af0f00dd601068', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd67618466b654b88a86c7ab026c267ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '86a81bd5f3fa69dfc58f6b1e26b1604a9f4b9c9ec73e34e4c625e2324a23d57615aa99826a06735c0ec67f10d5ba27b295200ea0773c8acad3fa0d1c1c22962b', 'id': '04cdf2a6-bdf2-48ee-8858-99567fa09f17', 'created_at': datetime.datetime(2026, 11, 3, 12, 20, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 21, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04cdf2a6-bdf2-48ee-8858-99567fa09f17/file', 'properties': {}}, 'image_service': }' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6213182b-c7be-43b2-97eb-08df88b2cd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6213182b-c7be-43b2-97eb-08df88b2cd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b8c84c6-74c1-45cb-a121-57eb74c45a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:02 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Volume f760f82e-ee84-4f94-ab6e-8c25ee3e7c83: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f760f82e-ee84-4f94-ab6e-8c25ee3e7c83', 'volume_size': 1, 'image_id': '04cdf2a6-bdf2-48ee-8858-99567fa09f17', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04cdf2a6-bdf2-48ee-8858-99567fa09f17', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9df613212625af1bc8af0f00dd601068', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd67618466b654b88a86c7ab026c267ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '86a81bd5f3fa69dfc58f6b1e26b1604a9f4b9c9ec73e34e4c625e2324a23d57615aa99826a06735c0ec67f10d5ba27b295200ea0773c8acad3fa0d1c1c22962b', 'id': '04cdf2a6-bdf2-48ee-8858-99567fa09f17', 'created_at': datetime.datetime(2026, 11, 3, 12, 20, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 21, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04cdf2a6-bdf2-48ee-8858-99567fa09f17/file', 'properties': {}}, 'image_service': } Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Trying to clone f760f82e-ee84-4f94-ab6e-8c25ee3e7c83 from image 04cdf2a6-bdf2-48ee-8858-99567fa09f17 at location (None, [{'url': 'file:///opt/stack/data/glance/images/04cdf2a6-bdf2-48ee-8858-99567fa09f17', 'metadata': {}}]). {{(pid=86725) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 13:21:02 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-132abade-ef3b-4f6a-b156-936a82b7bc25 tempest-VolumesListAdminTestJSON-1089775871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9124626a-1905-4560-a6ed-6d36b5491309" returned: 0 in 0.436s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-132abade-ef3b-4f6a-b156-936a82b7bc25 tempest-VolumesListAdminTestJSON-1089775871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9124626a-1905-4560-a6ed-6d36b5491309 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:02 devstack sudo[102029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9124626a-1905-4560-a6ed-6d36b5491309 Nov 03 13:21:02 devstack sudo[102029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_04cdf2a6-bdf2-48ee-8858-99567fa09f17_p8knfvnhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86725) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 13:21:02 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Image download 0.00 MB at 0.00 MB/s Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7be8973-b06a-4b1c-a7b1-4def7af39884]: (4, 'raw') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04cdf2a6-bdf2-48ee-8858-99567fa09f17_p8knfvnhdevstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:02 devstack sudo[102024]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-014f7812-49a9-4e0a-8d18-9bfb10682d43 tempest-TestStampPattern-2136190020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5fe549b9-6a6d-4ba1-aca4-a4c668a3c800" returned: 0 in 0.393s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-014f7812-49a9-4e0a-8d18-9bfb10682d43 tempest-TestStampPattern-2136190020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5fe549b9-6a6d-4ba1-aca4-a4c668a3c800 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:02 devstack sudo[102035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5fe549b9-6a6d-4ba1-aca4-a4c668a3c800 Nov 03 13:21:02 devstack sudo[102035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:02 devstack sudo[102032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04cdf2a6-bdf2-48ee-8858-99567fa09f17_p8knfvnhdevstack@QuobyteHD Nov 03 13:21:02 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:02 devstack sudo[102029]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-132abade-ef3b-4f6a-b156-936a82b7bc25 tempest-VolumesListAdminTestJSON-1089775871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-9124626a-1905-4560-a6ed-6d36b5491309" returned: 0 in 0.266s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-132abade-ef3b-4f6a-b156-936a82b7bc25 tempest-VolumesListAdminTestJSON-1089775871 None] Lock "cinder-quobyte-9124626a-1905-4560-a6ed-6d36b5491309" released by "delete_volume" :: held 0.766s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-132abade-ef3b-4f6a-b156-936a82b7bc25 tempest-VolumesListAdminTestJSON-1089775871 None] Created reservations ['626a5891-08f0-4e4b-8991-baa7a0f46e07', 'ff4d79dc-3493-4369-af81-189dc67d4e46', '8b4c957f-f52d-47a3-808e-88cbf5fd3bac', 'f301c356-c423-4fb6-9333-92ed0bc8b406'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-132abade-ef3b-4f6a-b156-936a82b7bc25 tempest-VolumesListAdminTestJSON-1089775871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-132abade-ef3b-4f6a-b156-936a82b7bc25 tempest-VolumesListAdminTestJSON-1089775871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-132abade-ef3b-4f6a-b156-936a82b7bc25 tempest-VolumesListAdminTestJSON-1089775871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-132abade-ef3b-4f6a-b156-936a82b7bc25 tempest-VolumesListAdminTestJSON-1089775871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-132abade-ef3b-4f6a-b156-936a82b7bc25 tempest-VolumesListAdminTestJSON-1089775871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-132abade-ef3b-4f6a-b156-936a82b7bc25 tempest-VolumesListAdminTestJSON-1089775871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:02 devstack sudo[102039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:21:02 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:02 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04cdf2a6-bdf2-48ee-8858-99567fa09f17_p8knfvnhdevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04cdf2a6-bdf2-48ee-8858-99567fa09f17_p8knfvnhdevstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:02 devstack sudo[102035]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-014f7812-49a9-4e0a-8d18-9bfb10682d43 tempest-TestStampPattern-2136190020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5fe549b9-6a6d-4ba1-aca4-a4c668a3c800" returned: 0 in 0.293s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-014f7812-49a9-4e0a-8d18-9bfb10682d43 tempest-TestStampPattern-2136190020 None] Lock "cinder-quobyte-5fe549b9-6a6d-4ba1-aca4-a4c668a3c800" released by "delete_volume" :: held 0.751s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-014f7812-49a9-4e0a-8d18-9bfb10682d43 tempest-TestStampPattern-2136190020 None] Created reservations ['fb775c51-6d34-4aa7-94c2-bbc764dbfc08', '67521d59-b39f-4cc6-abf8-d2c94b449368', '23e6bc48-e046-4cc3-b18c-f71cbce03de4', 'e801484a-5168-4ae7-bd0f-9f6c9565e7b5'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:21:02 devstack sudo[102044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04cdf2a6-bdf2-48ee-8858-99567fa09f17_p8knfvnhdevstack@QuobyteHD Nov 03 13:21:02 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-014f7812-49a9-4e0a-8d18-9bfb10682d43 tempest-TestStampPattern-2136190020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-014f7812-49a9-4e0a-8d18-9bfb10682d43 tempest-TestStampPattern-2136190020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-014f7812-49a9-4e0a-8d18-9bfb10682d43 tempest-TestStampPattern-2136190020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-014f7812-49a9-4e0a-8d18-9bfb10682d43 tempest-TestStampPattern-2136190020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-014f7812-49a9-4e0a-8d18-9bfb10682d43 tempest-TestStampPattern-2136190020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-014f7812-49a9-4e0a-8d18-9bfb10682d43 tempest-TestStampPattern-2136190020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:02 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-132abade-ef3b-4f6a-b156-936a82b7bc25 tempest-VolumesListAdminTestJSON-1089775871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.282s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:02 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-132abade-ef3b-4f6a-b156-936a82b7bc25 tempest-VolumesListAdminTestJSON-1089775871 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:21:02 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-132abade-ef3b-4f6a-b156-936a82b7bc25 tempest-VolumesListAdminTestJSON-1089775871 None] Deleted volume successfully. Nov 03 13:21:02 devstack sudo[102047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:21:02 devstack sudo[102047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:03 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-132abade-ef3b-4f6a-b156-936a82b7bc25 tempest-VolumesListAdminTestJSON-1089775871 None] Lock "cinder-9124626a-1905-4560-a6ed-6d36b5491309-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:03 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d4cc2384-ca25-4443-98bf-5025fae6a06d tempest-VolumesListAdminTestJSON-1089775871 None] Acquiring lock "cinder-a9c156eb-776b-4b1d-93fe-195c6c3e7c9c-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:03 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d4cc2384-ca25-4443-98bf-5025fae6a06d tempest-VolumesListAdminTestJSON-1089775871 None] Lock "cinder-a9c156eb-776b-4b1d-93fe-195c6c3e7c9c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:03 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d4cc2384-ca25-4443-98bf-5025fae6a06d tempest-VolumesListAdminTestJSON-1089775871 None] Acquiring lock "cinder-quobyte-a9c156eb-776b-4b1d-93fe-195c6c3e7c9c" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:03 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04cdf2a6-bdf2-48ee-8858-99567fa09f17_p8knfvnhdevstack@QuobyteHD" returned: 1 in 0.434s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04cdf2a6-bdf2-48ee-8858-99567fa09f17_p8knfvnhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:21:03 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Temporary image 04cdf2a6-bdf2-48ee-8858-99567fa09f17 is fetched for user 2155427026be44bcbeb6e6b6b142893c. {{(pid=86725) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 13:21:03 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d4cc2384-ca25-4443-98bf-5025fae6a06d tempest-VolumesListAdminTestJSON-1089775871 None] Lock "cinder-quobyte-a9c156eb-776b-4b1d-93fe-195c6c3e7c9c" acquired by "delete_volume" :: waited 0.023s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:03 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[820dea2d-5454-4ed2-93c7-cc6f343fd7b8]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:21:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d4cc2384-ca25-4443-98bf-5025fae6a06d tempest-VolumesListAdminTestJSON-1089775871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a9c156eb-776b-4b1d-93fe-195c6c3e7c9c {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:03 devstack sudo[102047]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-014f7812-49a9-4e0a-8d18-9bfb10682d43 tempest-TestStampPattern-2136190020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.332s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:03 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-014f7812-49a9-4e0a-8d18-9bfb10682d43 tempest-TestStampPattern-2136190020 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:21:03 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-014f7812-49a9-4e0a-8d18-9bfb10682d43 tempest-TestStampPattern-2136190020 None] Deleted volume successfully. Nov 03 13:21:03 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[739fa8cc-7d98-44ae-8f6f-8ab237891a8d]: (4, 'raw') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:21:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04cdf2a6-bdf2-48ee-8858-99567fa09f17_p8knfvnhdevstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:03 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-014f7812-49a9-4e0a-8d18-9bfb10682d43 tempest-TestStampPattern-2136190020 None] Lock "cinder-5fe549b9-6a6d-4ba1-aca4-a4c668a3c800-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:03 devstack sudo[102053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a9c156eb-776b-4b1d-93fe-195c6c3e7c9c Nov 03 13:21:03 devstack sudo[102053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:03 devstack sudo[102054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04cdf2a6-bdf2-48ee-8858-99567fa09f17_p8knfvnhdevstack@QuobyteHD Nov 03 13:21:03 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:03 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-77efcb34-82b4-4c63-8ef3-8a127b922af2 tempest-TestStampPattern-2136190020 None] Acquiring lock "cinder-0b760a85-4429-4311-8437-415298b66e97-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:03 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-77efcb34-82b4-4c63-8ef3-8a127b922af2 tempest-TestStampPattern-2136190020 None] Lock "cinder-0b760a85-4429-4311-8437-415298b66e97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:03 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-77efcb34-82b4-4c63-8ef3-8a127b922af2 tempest-TestStampPattern-2136190020 None] Acquiring lock "cinder-quobyte-4f9744fb-5c6e-44bb-b675-da63f0f8e616" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:03 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-77efcb34-82b4-4c63-8ef3-8a127b922af2 tempest-TestStampPattern-2136190020 None] Lock "cinder-quobyte-4f9744fb-5c6e-44bb-b675-da63f0f8e616" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:03 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-77efcb34-82b4-4c63-8ef3-8a127b922af2 tempest-TestStampPattern-2136190020 None] Acquiring lock "cinder-quobyte-0b760a85-4429-4311-8437-415298b66e97" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:03 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-77efcb34-82b4-4c63-8ef3-8a127b922af2 tempest-TestStampPattern-2136190020 None] Lock "cinder-quobyte-0b760a85-4429-4311-8437-415298b66e97" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:03 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-77efcb34-82b4-4c63-8ef3-8a127b922af2 tempest-TestStampPattern-2136190020 None] Deleting offline snapshot 0b760a85-4429-4311-8437-415298b66e97 of volume 4f9744fb-5c6e-44bb-b675-da63f0f8e616 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:21:03 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-77efcb34-82b4-4c63-8ef3-8a127b922af2 tempest-TestStampPattern-2136190020 None] snapshot_file for this snap is: volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616.0b760a85-4429-4311-8437-415298b66e97 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:21:03 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[525fd79b-3c4d-439d-be6d-f61fe24c7dd6]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:21:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-77efcb34-82b4-4c63-8ef3-8a127b922af2 tempest-TestStampPattern-2136190020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616.0b760a85-4429-4311-8437-415298b66e97 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:03 devstack sudo[102053]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d4cc2384-ca25-4443-98bf-5025fae6a06d tempest-VolumesListAdminTestJSON-1089775871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a9c156eb-776b-4b1d-93fe-195c6c3e7c9c" returned: 0 in 0.442s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d4cc2384-ca25-4443-98bf-5025fae6a06d tempest-VolumesListAdminTestJSON-1089775871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a9c156eb-776b-4b1d-93fe-195c6c3e7c9c {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:03 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04cdf2a6-bdf2-48ee-8858-99567fa09f17_p8knfvnhdevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04cdf2a6-bdf2-48ee-8858-99567fa09f17_p8knfvnhdevstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:03 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a9c156eb-776b-4b1d-93fe-195c6c3e7c9c Nov 03 13:21:03 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:03 devstack sudo[102060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616.0b760a85-4429-4311-8437-415298b66e97 Nov 03 13:21:03 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:03 devstack sudo[102065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04cdf2a6-bdf2-48ee-8858-99567fa09f17_p8knfvnhdevstack@QuobyteHD Nov 03 13:21:03 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:03 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d4cc2384-ca25-4443-98bf-5025fae6a06d tempest-VolumesListAdminTestJSON-1089775871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a9c156eb-776b-4b1d-93fe-195c6c3e7c9c" returned: 0 in 0.255s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:03 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d4cc2384-ca25-4443-98bf-5025fae6a06d tempest-VolumesListAdminTestJSON-1089775871 None] Lock "cinder-quobyte-a9c156eb-776b-4b1d-93fe-195c6c3e7c9c" released by "delete_volume" :: held 0.752s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:04 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-d4cc2384-ca25-4443-98bf-5025fae6a06d tempest-VolumesListAdminTestJSON-1089775871 None] Created reservations ['bb475cb5-b290-42fe-8f02-c933a4057058', 'e778b524-23cb-45fa-8336-9315b8b9d80b', 'd3209198-2747-4506-922f-f33f92c36a13', '421476d5-3822-4c37-876c-c58cc7adeb9a'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:21:04 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-77efcb34-82b4-4c63-8ef3-8a127b922af2 tempest-TestStampPattern-2136190020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616.0b760a85-4429-4311-8437-415298b66e97" returned: 0 in 0.406s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:04 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-77efcb34-82b4-4c63-8ef3-8a127b922af2 tempest-TestStampPattern-2136190020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:21:04 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[1312785c-68ea-410d-af85-3232e394855f]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:21:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-77efcb34-82b4-4c63-8ef3-8a127b922af2 tempest-TestStampPattern-2136190020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:04 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04cdf2a6-bdf2-48ee-8858-99567fa09f17_p8knfvnhdevstack@QuobyteHD" returned: 1 in 0.385s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04cdf2a6-bdf2-48ee-8858-99567fa09f17_p8knfvnhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:21:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:04 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f760f82e-ee84-4f94-ab6e-8c25ee3e7c83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d67618466b654b88a86c7ab026c267ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:21:02Z,use_quota=True,user_id='2155427026be44bcbeb6e6b6b142893c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:21:04 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Creating volume f760f82e-ee84-4f94-ab6e-8c25ee3e7c83 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:21:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:04 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:04 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:04 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:21:04 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:21:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f760f82e-ee84-4f94-ab6e-8c25ee3e7c83 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:04 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f760f82e-ee84-4f94-ab6e-8c25ee3e7c83 1073741824 Nov 03 13:21:04 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d4cc2384-ca25-4443-98bf-5025fae6a06d tempest-VolumesListAdminTestJSON-1089775871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d4cc2384-ca25-4443-98bf-5025fae6a06d tempest-VolumesListAdminTestJSON-1089775871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:04 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d4cc2384-ca25-4443-98bf-5025fae6a06d tempest-VolumesListAdminTestJSON-1089775871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:04 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d4cc2384-ca25-4443-98bf-5025fae6a06d tempest-VolumesListAdminTestJSON-1089775871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d4cc2384-ca25-4443-98bf-5025fae6a06d tempest-VolumesListAdminTestJSON-1089775871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d4cc2384-ca25-4443-98bf-5025fae6a06d tempest-VolumesListAdminTestJSON-1089775871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:04 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616 Nov 03 13:21:04 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:04 devstack sudo[102078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:21:04 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:04 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d4cc2384-ca25-4443-98bf-5025fae6a06d tempest-VolumesListAdminTestJSON-1089775871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.312s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:04 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-d4cc2384-ca25-4443-98bf-5025fae6a06d tempest-VolumesListAdminTestJSON-1089775871 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:21:04 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-d4cc2384-ca25-4443-98bf-5025fae6a06d tempest-VolumesListAdminTestJSON-1089775871 None] Deleted volume successfully. Nov 03 13:21:04 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d4cc2384-ca25-4443-98bf-5025fae6a06d tempest-VolumesListAdminTestJSON-1089775871 None] Lock "cinder-a9c156eb-776b-4b1d-93fe-195c6c3e7c9c-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:04 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f760f82e-ee84-4f94-ab6e-8c25ee3e7c83 1073741824" returned: 0 in 0.534s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:04 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-77efcb34-82b4-4c63-8ef3-8a127b922af2 tempest-TestStampPattern-2136190020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616" returned: 0 in 0.664s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-77efcb34-82b4-4c63-8ef3-8a127b922af2 tempest-TestStampPattern-2136190020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616.0b760a85-4429-4311-8437-415298b66e97 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f760f82e-ee84-4f94-ab6e-8c25ee3e7c83 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:04 devstack sudo[102090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616.0b760a85-4429-4311-8437-415298b66e97 Nov 03 13:21:04 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:04 devstack sudo[102092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f760f82e-ee84-4f94-ab6e-8c25ee3e7c83 Nov 03 13:21:04 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:05 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f760f82e-ee84-4f94-ab6e-8c25ee3e7c83" returned: 0 in 0.269s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:05 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:21:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:05 devstack cinder-volume[86725]: DEBUG cinder.volume.volume_utils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Attempting download of 04cdf2a6-bdf2-48ee-8858-99567fa09f17 ((None, [{'url': 'file:///opt/stack/data/glance/images/04cdf2a6-bdf2-48ee-8858-99567fa09f17', 'metadata': {}}])) to volume f760f82e-ee84-4f94-ab6e-8c25ee3e7c83. {{(pid=86725) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 13:21:05 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3e7bf0-a1b1-41d6-9cfa-6e866abb6d37]: (4, 'raw') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:21:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04cdf2a6-bdf2-48ee-8858-99567fa09f17_uvpq2j61 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:05 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-77efcb34-82b4-4c63-8ef3-8a127b922af2 tempest-TestStampPattern-2136190020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616.0b760a85-4429-4311-8437-415298b66e97" returned: 0 in 0.410s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-77efcb34-82b4-4c63-8ef3-8a127b922af2 tempest-TestStampPattern-2136190020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616.0b760a85-4429-4311-8437-415298b66e97 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:05 devstack sudo[102099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616.0b760a85-4429-4311-8437-415298b66e97 Nov 03 13:21:05 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:05 devstack sudo[102098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04cdf2a6-bdf2-48ee-8858-99567fa09f17_uvpq2j61 Nov 03 13:21:05 devstack sudo[102098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:05 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-77efcb34-82b4-4c63-8ef3-8a127b922af2 tempest-TestStampPattern-2136190020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616.0b760a85-4429-4311-8437-415298b66e97" returned: 0 in 0.269s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:05 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-77efcb34-82b4-4c63-8ef3-8a127b922af2 tempest-TestStampPattern-2136190020 None] Lock "cinder-quobyte-0b760a85-4429-4311-8437-415298b66e97" released by "_delete_snapshot" :: held 1.879s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:05 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-77efcb34-82b4-4c63-8ef3-8a127b922af2 tempest-TestStampPattern-2136190020 None] Lock "cinder-quobyte-4f9744fb-5c6e-44bb-b675-da63f0f8e616" released by "delete_snapshot" :: held 1.900s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:05 devstack sudo[102098]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04cdf2a6-bdf2-48ee-8858-99567fa09f17_uvpq2j61" returned: 0 in 0.382s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04cdf2a6-bdf2-48ee-8858-99567fa09f17_uvpq2j61 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:05 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-77efcb34-82b4-4c63-8ef3-8a127b922af2 tempest-TestStampPattern-2136190020 None] Created reservations ['0254498a-f8dc-42b3-954f-cf0f3b94c23d', '74ee07c1-b570-4154-9230-8a8ffb3c6713', '2c19df20-4e6e-461f-9f12-0056f4689ad8', 'e2e12871-555b-440e-8e43-7a3f805257ce'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:21:05 devstack sudo[102105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04cdf2a6-bdf2-48ee-8858-99567fa09f17_uvpq2j61 Nov 03 13:21:05 devstack sudo[102105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:05 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-77efcb34-82b4-4c63-8ef3-8a127b922af2 tempest-TestStampPattern-2136190020 None] Delete snapshot completed successfully. Nov 03 13:21:05 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-77efcb34-82b4-4c63-8ef3-8a127b922af2 tempest-TestStampPattern-2136190020 None] Lock "cinder-0b760a85-4429-4311-8437-415298b66e97-delete_snapshot" released by "delete_snapshot" :: held 2.111s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:05 devstack sudo[102105]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04cdf2a6-bdf2-48ee-8858-99567fa09f17_uvpq2j61" returned: 1 in 0.368s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04cdf2a6-bdf2-48ee-8858-99567fa09f17_uvpq2j61' failed. Not Retrying. {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:21:05 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bd49ad-6b48-4b6d-aec9-c12af30b1d8c]: (4, 'raw') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:21:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04cdf2a6-bdf2-48ee-8858-99567fa09f17_p8knfvnhdevstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:06 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04cdf2a6-bdf2-48ee-8858-99567fa09f17_p8knfvnhdevstack@QuobyteHD Nov 03 13:21:06 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:06 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04cdf2a6-bdf2-48ee-8858-99567fa09f17_p8knfvnhdevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04cdf2a6-bdf2-48ee-8858-99567fa09f17_p8knfvnhdevstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:06 devstack sudo[102114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04cdf2a6-bdf2-48ee-8858-99567fa09f17_p8knfvnhdevstack@QuobyteHD Nov 03 13:21:06 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:06 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04cdf2a6-bdf2-48ee-8858-99567fa09f17_p8knfvnhdevstack@QuobyteHD" returned: 1 in 0.406s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04cdf2a6-bdf2-48ee-8858-99567fa09f17_p8knfvnhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:21:06 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] 04cdf2a6-bdf2-48ee-8858-99567fa09f17 was raw, converting to qcow2 {{(pid=86725) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 13:21:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_04cdf2a6-bdf2-48ee-8858-99567fa09f17_p8knfvnhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f760f82e-ee84-4f94-ab6e-8c25ee3e7c83 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:06 devstack sudo[102121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_04cdf2a6-bdf2-48ee-8858-99567fa09f17_p8knfvnhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f760f82e-ee84-4f94-ab6e-8c25ee3e7c83 Nov 03 13:21:06 devstack sudo[102121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:07 devstack sudo[102121]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_04cdf2a6-bdf2-48ee-8858-99567fa09f17_p8knfvnhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f760f82e-ee84-4f94-ab6e-8c25ee3e7c83" returned: 0 in 0.803s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:07 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_04cdf2a6-bdf2-48ee-8858-99567fa09f17_p8knfvnhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f760f82e-ee84-4f94-ab6e-8c25ee3e7c83 {{(pid=86725) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:21:07 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 13:21:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f760f82e-ee84-4f94-ab6e-8c25ee3e7c83 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:07 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f760f82e-ee84-4f94-ab6e-8c25ee3e7c83 1G Nov 03 13:21:07 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:07 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f760f82e-ee84-4f94-ab6e-8c25ee3e7c83 1G" returned: 0 in 0.413s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:07 devstack cinder-volume[86725]: DEBUG cinder.volume.volume_utils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Downloaded image 04cdf2a6-bdf2-48ee-8858-99567fa09f17 ((None, [{'url': 'file:///opt/stack/data/glance/images/04cdf2a6-bdf2-48ee-8858-99567fa09f17', 'metadata': {}}])) to volume f760f82e-ee84-4f94-ab6e-8c25ee3e7c83 successfully. {{(pid=86725) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 13:21:07 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Temporary image 04cdf2a6-bdf2-48ee-8858-99567fa09f17 for user 2155427026be44bcbeb6e6b6b142893c is deleted. {{(pid=86725) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 13:21:07 devstack cinder-volume[86725]: DEBUG cinder.volume.volume_utils [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Marking volume f760f82e-ee84-4f94-ab6e-8c25ee3e7c83 as bootable. {{(pid=86725) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 13:21:07 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Copying metadata from image 04cdf2a6-bdf2-48ee-8858-99567fa09f17 to f760f82e-ee84-4f94-ab6e-8c25ee3e7c83. {{(pid=86725) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 13:21:07 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Creating volume glance metadata for volume f760f82e-ee84-4f94-ab6e-8c25ee3e7c83 backed by image 04cdf2a6-bdf2-48ee-8858-99567fa09f17 with: {'image_id': '04cdf2a6-bdf2-48ee-8858-99567fa09f17', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '9df613212625af1bc8af0f00dd601068', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86725) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 13:21:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b8c84c6-74c1-45cb-a121-57eb74c45a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f760f82e-ee84-4f94-ab6e-8c25ee3e7c83', 'volume_size': 1, 'image_id': '04cdf2a6-bdf2-48ee-8858-99567fa09f17', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04cdf2a6-bdf2-48ee-8858-99567fa09f17', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9df613212625af1bc8af0f00dd601068', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd67618466b654b88a86c7ab026c267ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '86a81bd5f3fa69dfc58f6b1e26b1604a9f4b9c9ec73e34e4c625e2324a23d57615aa99826a06735c0ec67f10d5ba27b295200ea0773c8acad3fa0d1c1c22962b', 'id': '04cdf2a6-bdf2-48ee-8858-99567fa09f17', 'created_at': datetime.datetime(2026, 11, 3, 12, 20, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 21, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04cdf2a6-bdf2-48ee-8858-99567fa09f17/file', 'properties': {}}, 'image_service': }' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c319882-8ff7-4e04-9925-4eafac4fa3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:08 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Volume volume-f760f82e-ee84-4f94-ab6e-8c25ee3e7c83 (f760f82e-ee84-4f94-ab6e-8c25ee3e7c83): created successfully Nov 03 13:21:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c319882-8ff7-4e04-9925-4eafac4fa3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Flow 'volume_create_manager' (f286679d-7e5b-4bba-b8c7-09581d24eacb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:21:08 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-e67ada14-c6e4-4d4c-a8b5-af939de52f5e tempest-VolumeImageDependencyTests-1093717667 None] Created volume successfully. Nov 03 13:21:08 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3f34b82d-9299-4235-8323-c6ed306c6138 tempest-VolumeImageDependencyTests-1093717667 None] Acquiring lock "cinder-f760f82e-ee84-4f94-ab6e-8c25ee3e7c83-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:08 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3f34b82d-9299-4235-8323-c6ed306c6138 tempest-VolumeImageDependencyTests-1093717667 None] Lock "cinder-f760f82e-ee84-4f94-ab6e-8c25ee3e7c83-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:08 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3f34b82d-9299-4235-8323-c6ed306c6138 tempest-VolumeImageDependencyTests-1093717667 None] Acquiring lock "cinder-quobyte-f760f82e-ee84-4f94-ab6e-8c25ee3e7c83" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:08 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3f34b82d-9299-4235-8323-c6ed306c6138 tempest-VolumeImageDependencyTests-1093717667 None] Lock "cinder-quobyte-f760f82e-ee84-4f94-ab6e-8c25ee3e7c83" acquired by "delete_volume" :: waited 0.025s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:08 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9703c0-8ada-4e01-b339-d51261a0668d]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:21:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3f34b82d-9299-4235-8323-c6ed306c6138 tempest-VolumeImageDependencyTests-1093717667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f760f82e-ee84-4f94-ab6e-8c25ee3e7c83 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:08 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f760f82e-ee84-4f94-ab6e-8c25ee3e7c83 Nov 03 13:21:08 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:08 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3f34b82d-9299-4235-8323-c6ed306c6138 tempest-VolumeImageDependencyTests-1093717667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f760f82e-ee84-4f94-ab6e-8c25ee3e7c83" returned: 0 in 0.426s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3f34b82d-9299-4235-8323-c6ed306c6138 tempest-VolumeImageDependencyTests-1093717667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f760f82e-ee84-4f94-ab6e-8c25ee3e7c83 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:08 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f760f82e-ee84-4f94-ab6e-8c25ee3e7c83 Nov 03 13:21:08 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:09 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3f34b82d-9299-4235-8323-c6ed306c6138 tempest-VolumeImageDependencyTests-1093717667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f760f82e-ee84-4f94-ab6e-8c25ee3e7c83" returned: 0 in 0.296s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:09 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3f34b82d-9299-4235-8323-c6ed306c6138 tempest-VolumeImageDependencyTests-1093717667 None] Lock "cinder-quobyte-f760f82e-ee84-4f94-ab6e-8c25ee3e7c83" released by "delete_volume" :: held 0.797s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:09 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-3f34b82d-9299-4235-8323-c6ed306c6138 tempest-VolumeImageDependencyTests-1093717667 None] Created reservations ['6bff7286-9a9c-44ab-a6ec-be7ab391e745', 'cd0e41b3-2177-47bd-a178-272bca0a3a2b', '616c8168-551e-4773-abf0-299f6cda1e56', '494168ef-fb66-4a53-a2f4-204f6be625ff'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:21:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3f34b82d-9299-4235-8323-c6ed306c6138 tempest-VolumeImageDependencyTests-1093717667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3f34b82d-9299-4235-8323-c6ed306c6138 tempest-VolumeImageDependencyTests-1093717667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:09 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3f34b82d-9299-4235-8323-c6ed306c6138 tempest-VolumeImageDependencyTests-1093717667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:09 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3f34b82d-9299-4235-8323-c6ed306c6138 tempest-VolumeImageDependencyTests-1093717667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3f34b82d-9299-4235-8323-c6ed306c6138 tempest-VolumeImageDependencyTests-1093717667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3f34b82d-9299-4235-8323-c6ed306c6138 tempest-VolumeImageDependencyTests-1093717667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:09 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:21:09 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:09 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3f34b82d-9299-4235-8323-c6ed306c6138 tempest-VolumeImageDependencyTests-1093717667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.279s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:09 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3f34b82d-9299-4235-8323-c6ed306c6138 tempest-VolumeImageDependencyTests-1093717667 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:21:09 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-3f34b82d-9299-4235-8323-c6ed306c6138 tempest-VolumeImageDependencyTests-1093717667 None] Deleted volume successfully. Nov 03 13:21:09 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3f34b82d-9299-4235-8323-c6ed306c6138 tempest-VolumeImageDependencyTests-1093717667 None] Lock "cinder-f760f82e-ee84-4f94-ab6e-8c25ee3e7c83-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:09 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0f64d2cc-a1f7-4b39-b3e9-54bce02db3c6 tempest-TestStampPattern-2136190020 None] Acquiring lock "cinder-4f9744fb-5c6e-44bb-b675-da63f0f8e616-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:09 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0f64d2cc-a1f7-4b39-b3e9-54bce02db3c6 tempest-TestStampPattern-2136190020 None] Lock "cinder-4f9744fb-5c6e-44bb-b675-da63f0f8e616-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:09 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0f64d2cc-a1f7-4b39-b3e9-54bce02db3c6 tempest-TestStampPattern-2136190020 None] Acquiring lock "cinder-quobyte-4f9744fb-5c6e-44bb-b675-da63f0f8e616" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:09 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0f64d2cc-a1f7-4b39-b3e9-54bce02db3c6 tempest-TestStampPattern-2136190020 None] Lock "cinder-quobyte-4f9744fb-5c6e-44bb-b675-da63f0f8e616" acquired by "delete_volume" :: waited 0.018s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:09 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0b3425-b167-46fe-ab4a-2c1b43866960]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:21:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0f64d2cc-a1f7-4b39-b3e9-54bce02db3c6 tempest-TestStampPattern-2136190020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:10 devstack sudo[102167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616 Nov 03 13:21:10 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:10 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0f64d2cc-a1f7-4b39-b3e9-54bce02db3c6 tempest-TestStampPattern-2136190020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616" returned: 0 in 0.401s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0f64d2cc-a1f7-4b39-b3e9-54bce02db3c6 tempest-TestStampPattern-2136190020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:10 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616 Nov 03 13:21:10 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:10 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0f64d2cc-a1f7-4b39-b3e9-54bce02db3c6 tempest-TestStampPattern-2136190020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-4f9744fb-5c6e-44bb-b675-da63f0f8e616" returned: 0 in 0.274s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:10 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0f64d2cc-a1f7-4b39-b3e9-54bce02db3c6 tempest-TestStampPattern-2136190020 None] Lock "cinder-quobyte-4f9744fb-5c6e-44bb-b675-da63f0f8e616" released by "delete_volume" :: held 0.764s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:10 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-0f64d2cc-a1f7-4b39-b3e9-54bce02db3c6 tempest-TestStampPattern-2136190020 None] Created reservations ['510c47dc-c3c0-4888-b0f8-0418b46e6c46', '9f2d5c5d-d0df-4955-bb78-073adf09fa8d', '62e6aa83-b779-45c6-ae88-f6b230c2e1d6', '832d90fa-dc80-46e7-a215-8a1791d74331'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:21:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0f64d2cc-a1f7-4b39-b3e9-54bce02db3c6 tempest-TestStampPattern-2136190020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0f64d2cc-a1f7-4b39-b3e9-54bce02db3c6 tempest-TestStampPattern-2136190020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:10 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0f64d2cc-a1f7-4b39-b3e9-54bce02db3c6 tempest-TestStampPattern-2136190020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:10 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0f64d2cc-a1f7-4b39-b3e9-54bce02db3c6 tempest-TestStampPattern-2136190020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0f64d2cc-a1f7-4b39-b3e9-54bce02db3c6 tempest-TestStampPattern-2136190020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0f64d2cc-a1f7-4b39-b3e9-54bce02db3c6 tempest-TestStampPattern-2136190020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:10 devstack sudo[102175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:21:10 devstack sudo[102175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:11 devstack sudo[102175]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0f64d2cc-a1f7-4b39-b3e9-54bce02db3c6 tempest-TestStampPattern-2136190020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.301s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:11 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-0f64d2cc-a1f7-4b39-b3e9-54bce02db3c6 tempest-TestStampPattern-2136190020 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:21:11 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-0f64d2cc-a1f7-4b39-b3e9-54bce02db3c6 tempest-TestStampPattern-2136190020 None] Deleted volume successfully. Nov 03 13:21:11 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0f64d2cc-a1f7-4b39-b3e9-54bce02db3c6 tempest-TestStampPattern-2136190020 None] Lock "cinder-4f9744fb-5c6e-44bb-b675-da63f0f8e616-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:14 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:21:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] Flow 'volume_create_manager' (9213944d-451e-4eb1-a436-6c7c15d3f716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:21:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4009626e-f528-4d39-8114-c7893fd2e936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4009626e-f528-4d39-8114-c7893fd2e936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1651308502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=267124e1-8c99-44a2-a9eb-5cf441a6f512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d02321bebfb0498caeea9f99ab45ad75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:21:14Z,use_quota=True,user_id='31efb884c51d4bfd8eb841407a15c772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97948d3f-ac7e-43fe-a70b-f6d04f1c2cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97948d3f-ac7e-43fe-a70b-f6d04f1c2cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a241f80-182e-4d1f-a88c-5f68e70af943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a241f80-182e-4d1f-a88c-5f68e70af943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '267124e1-8c99-44a2-a9eb-5cf441a6f512', 'volume_name': 'volume-267124e1-8c99-44a2-a9eb-5cf441a6f512', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0a4dd5-837b-479a-8c1e-3c36ad55361f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0a4dd5-837b-479a-8c1e-3c36ad55361f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b95cd5a8-3327-4b49-8d14-f4c77944ab58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:14 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] Volume 267124e1-8c99-44a2-a9eb-5cf441a6f512: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-267124e1-8c99-44a2-a9eb-5cf441a6f512', 'volume_size': 1} Nov 03 13:21:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:14 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1651308502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=267124e1-8c99-44a2-a9eb-5cf441a6f512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d02321bebfb0498caeea9f99ab45ad75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:21:14Z,use_quota=True,user_id='31efb884c51d4bfd8eb841407a15c772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:21:14 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] Creating volume 267124e1-8c99-44a2-a9eb-5cf441a6f512 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:21:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:14 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:14 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:14 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:21:14 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:21:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-267124e1-8c99-44a2-a9eb-5cf441a6f512 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:14 devstack sudo[102179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-267124e1-8c99-44a2-a9eb-5cf441a6f512 1073741824 Nov 03 13:21:14 devstack sudo[102179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:14 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:21:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] Flow 'volume_create_manager' (b4a71beb-d6f7-422b-be76-aa0b413238a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:21:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98541fa2-c33a-4035-8303-6c5ef73a2fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98541fa2-c33a-4035-8303-6c5ef73a2fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-943855070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a380f3db-5530-4de6-93bd-2426b709290f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c157ac39cae4c96bb43237aee7f70cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:21:15Z,use_quota=True,user_id='1c2d4dab11ed4a798ce24362cad5ffe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (944e1180-05b4-45e6-8da4-8875f8e9ce8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (944e1180-05b4-45e6-8da4-8875f8e9ce8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d30178-2a93-4090-bb72-9606c3dcb610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d30178-2a93-4090-bb72-9606c3dcb610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a380f3db-5530-4de6-93bd-2426b709290f', 'volume_name': 'volume-a380f3db-5530-4de6-93bd-2426b709290f', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eb911b4-9c02-4a39-919d-bd51db427161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eb911b4-9c02-4a39-919d-bd51db427161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (471eaf7a-e58d-4ed1-aabd-f10c630f9054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:14 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] Volume a380f3db-5530-4de6-93bd-2426b709290f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a380f3db-5530-4de6-93bd-2426b709290f', 'volume_size': 1} Nov 03 13:21:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:15 devstack sudo[102179]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-267124e1-8c99-44a2-a9eb-5cf441a6f512 1073741824" returned: 0 in 0.435s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-267124e1-8c99-44a2-a9eb-5cf441a6f512 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:15 devstack sudo[102184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-267124e1-8c99-44a2-a9eb-5cf441a6f512 Nov 03 13:21:15 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:15 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-267124e1-8c99-44a2-a9eb-5cf441a6f512" returned: 0 in 0.346s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:15 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:21:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.705s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:15 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-943855070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a380f3db-5530-4de6-93bd-2426b709290f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c157ac39cae4c96bb43237aee7f70cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:21:15Z,use_quota=True,user_id='1c2d4dab11ed4a798ce24362cad5ffe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:21:15 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] Creating volume a380f3db-5530-4de6-93bd-2426b709290f {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:21:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:15 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:15 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:15 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:21:15 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:21:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a380f3db-5530-4de6-93bd-2426b709290f 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:15 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b95cd5a8-3327-4b49-8d14-f4c77944ab58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-267124e1-8c99-44a2-a9eb-5cf441a6f512', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:15 devstack sudo[102187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a380f3db-5530-4de6-93bd-2426b709290f 1073741824 Nov 03 13:21:15 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:15 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (790effa0-eef8-409a-bf39-8f88744e005e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:15 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] Volume volume-267124e1-8c99-44a2-a9eb-5cf441a6f512 (267124e1-8c99-44a2-a9eb-5cf441a6f512): created successfully Nov 03 13:21:15 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (790effa0-eef8-409a-bf39-8f88744e005e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:15 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] Flow 'volume_create_manager' (9213944d-451e-4eb1-a436-6c7c15d3f716) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:21:15 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-09d06d38-8d94-42d6-a9ec-109737fcbc27 tempest-ProjectReaderTests-596586335 None] Created volume successfully. Nov 03 13:21:15 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a380f3db-5530-4de6-93bd-2426b709290f 1073741824" returned: 0 in 0.440s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a380f3db-5530-4de6-93bd-2426b709290f {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:16 devstack sudo[102194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a380f3db-5530-4de6-93bd-2426b709290f Nov 03 13:21:16 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:16 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a380f3db-5530-4de6-93bd-2426b709290f" returned: 0 in 0.278s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:16 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:21:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:16 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (471eaf7a-e58d-4ed1-aabd-f10c630f9054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a380f3db-5530-4de6-93bd-2426b709290f', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:16 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78fb746e-2518-440b-a54b-6858571aa50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:16 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] Volume volume-a380f3db-5530-4de6-93bd-2426b709290f (a380f3db-5530-4de6-93bd-2426b709290f): created successfully Nov 03 13:21:16 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78fb746e-2518-440b-a54b-6858571aa50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:16 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] Flow 'volume_create_manager' (b4a71beb-d6f7-422b-be76-aa0b413238a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:21:16 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-96822107-9901-4a85-8e43-98281e65784c tempest-VolumesMetadataTest-1891170323 None] Created volume successfully. Nov 03 13:21:16 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-cb618d07-7572-41fd-9e1d-918115b8a727 tempest-ProjectReaderTests-596586335 None] Acquiring lock "cinder-267124e1-8c99-44a2-a9eb-5cf441a6f512-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:16 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-cb618d07-7572-41fd-9e1d-918115b8a727 tempest-ProjectReaderTests-596586335 None] Lock "cinder-267124e1-8c99-44a2-a9eb-5cf441a6f512-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:16 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-cb618d07-7572-41fd-9e1d-918115b8a727 tempest-ProjectReaderTests-596586335 None] Acquiring lock "cinder-quobyte-267124e1-8c99-44a2-a9eb-5cf441a6f512" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:16 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-cb618d07-7572-41fd-9e1d-918115b8a727 tempest-ProjectReaderTests-596586335 None] Lock "cinder-quobyte-267124e1-8c99-44a2-a9eb-5cf441a6f512" acquired by "delete_volume" :: waited 0.016s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:16 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42d5f13-8e41-4323-804d-3d8768e32776]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:21:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-cb618d07-7572-41fd-9e1d-918115b8a727 tempest-ProjectReaderTests-596586335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-267124e1-8c99-44a2-a9eb-5cf441a6f512 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:16 devstack sudo[102198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-267124e1-8c99-44a2-a9eb-5cf441a6f512 Nov 03 13:21:16 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:17 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-cb618d07-7572-41fd-9e1d-918115b8a727 tempest-ProjectReaderTests-596586335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-267124e1-8c99-44a2-a9eb-5cf441a6f512" returned: 0 in 0.499s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-cb618d07-7572-41fd-9e1d-918115b8a727 tempest-ProjectReaderTests-596586335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-267124e1-8c99-44a2-a9eb-5cf441a6f512 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:17 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-267124e1-8c99-44a2-a9eb-5cf441a6f512 Nov 03 13:21:17 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:17 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-054617c8-5cba-45da-b370-ca5016496a3d tempest-VolumesMetadataTest-1891170323 None] Acquiring lock "cinder-a380f3db-5530-4de6-93bd-2426b709290f-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:17 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-054617c8-5cba-45da-b370-ca5016496a3d tempest-VolumesMetadataTest-1891170323 None] Lock "cinder-a380f3db-5530-4de6-93bd-2426b709290f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:17 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-054617c8-5cba-45da-b370-ca5016496a3d tempest-VolumesMetadataTest-1891170323 None] Acquiring lock "cinder-quobyte-a380f3db-5530-4de6-93bd-2426b709290f" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:17 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-054617c8-5cba-45da-b370-ca5016496a3d tempest-VolumesMetadataTest-1891170323 None] Lock "cinder-quobyte-a380f3db-5530-4de6-93bd-2426b709290f" acquired by "delete_volume" :: waited 0.016s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:17 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3e4d98-3388-4586-84e3-6629b07d67d3]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:21:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-054617c8-5cba-45da-b370-ca5016496a3d tempest-VolumesMetadataTest-1891170323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a380f3db-5530-4de6-93bd-2426b709290f {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:17 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-cb618d07-7572-41fd-9e1d-918115b8a727 tempest-ProjectReaderTests-596586335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-267124e1-8c99-44a2-a9eb-5cf441a6f512" returned: 0 in 0.285s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:17 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-cb618d07-7572-41fd-9e1d-918115b8a727 tempest-ProjectReaderTests-596586335 None] Lock "cinder-quobyte-267124e1-8c99-44a2-a9eb-5cf441a6f512" released by "delete_volume" :: held 0.828s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:17 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a380f3db-5530-4de6-93bd-2426b709290f Nov 03 13:21:17 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:17 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-cb618d07-7572-41fd-9e1d-918115b8a727 tempest-ProjectReaderTests-596586335 None] Created reservations ['3baa369b-1193-4788-a1bf-005c3d39e552', 'd47783a9-c376-4595-a6e6-dced7caef70a', '63bcd4d0-fc56-49bd-862a-955f9ee68001', '4ba5f835-f28e-4e84-8645-baae89770770'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:21:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-cb618d07-7572-41fd-9e1d-918115b8a727 tempest-ProjectReaderTests-596586335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-cb618d07-7572-41fd-9e1d-918115b8a727 tempest-ProjectReaderTests-596586335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:17 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-cb618d07-7572-41fd-9e1d-918115b8a727 tempest-ProjectReaderTests-596586335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:17 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-cb618d07-7572-41fd-9e1d-918115b8a727 tempest-ProjectReaderTests-596586335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-cb618d07-7572-41fd-9e1d-918115b8a727 tempest-ProjectReaderTests-596586335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-cb618d07-7572-41fd-9e1d-918115b8a727 tempest-ProjectReaderTests-596586335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:17 devstack sudo[102209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:21:17 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:17 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-054617c8-5cba-45da-b370-ca5016496a3d tempest-VolumesMetadataTest-1891170323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a380f3db-5530-4de6-93bd-2426b709290f" returned: 0 in 0.413s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-054617c8-5cba-45da-b370-ca5016496a3d tempest-VolumesMetadataTest-1891170323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a380f3db-5530-4de6-93bd-2426b709290f {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:17 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a380f3db-5530-4de6-93bd-2426b709290f Nov 03 13:21:17 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:18 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-cb618d07-7572-41fd-9e1d-918115b8a727 tempest-ProjectReaderTests-596586335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.332s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-cb618d07-7572-41fd-9e1d-918115b8a727 tempest-ProjectReaderTests-596586335 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:21:18 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-cb618d07-7572-41fd-9e1d-918115b8a727 tempest-ProjectReaderTests-596586335 None] Deleted volume successfully. Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-cb618d07-7572-41fd-9e1d-918115b8a727 tempest-ProjectReaderTests-596586335 None] Lock "cinder-267124e1-8c99-44a2-a9eb-5cf441a6f512-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:18 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-054617c8-5cba-45da-b370-ca5016496a3d tempest-VolumesMetadataTest-1891170323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a380f3db-5530-4de6-93bd-2426b709290f" returned: 0 in 0.342s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-054617c8-5cba-45da-b370-ca5016496a3d tempest-VolumesMetadataTest-1891170323 None] Lock "cinder-quobyte-a380f3db-5530-4de6-93bd-2426b709290f" released by "delete_volume" :: held 0.811s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-054617c8-5cba-45da-b370-ca5016496a3d tempest-VolumesMetadataTest-1891170323 None] Created reservations ['d84dbd9d-d708-4982-8b50-d60217781ae3', 'da2c4ef5-ff77-4a82-967a-9caa14da85c8', '93dfd31b-f44f-4069-8d83-4e0f4a664728', '65ef5f71-b030-454b-9a6b-58af1c97d12f'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-054617c8-5cba-45da-b370-ca5016496a3d tempest-VolumesMetadataTest-1891170323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-054617c8-5cba-45da-b370-ca5016496a3d tempest-VolumesMetadataTest-1891170323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-054617c8-5cba-45da-b370-ca5016496a3d tempest-VolumesMetadataTest-1891170323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-054617c8-5cba-45da-b370-ca5016496a3d tempest-VolumesMetadataTest-1891170323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-054617c8-5cba-45da-b370-ca5016496a3d tempest-VolumesMetadataTest-1891170323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-054617c8-5cba-45da-b370-ca5016496a3d tempest-VolumesMetadataTest-1891170323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:21:18 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:21:18 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] Flow 'volume_create_manager' (9ed1589a-bf17-4825-8749-255e6444e201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (072077c8-e4d5-4b03-a01c-d9db77e75a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (072077c8-e4d5-4b03-a01c-d9db77e75a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1876630277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=220640a4-e3bb-4dc3-9a71-776c224ba808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d02321bebfb0498caeea9f99ab45ad75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:21:18Z,use_quota=True,user_id='31efb884c51d4bfd8eb841407a15c772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbb0ff56-829d-41b4-989c-ac6f6d676031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbb0ff56-829d-41b4-989c-ac6f6d676031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fda6a48f-24f7-49c5-a5a6-008053ad7b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fda6a48f-24f7-49c5-a5a6-008053ad7b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '220640a4-e3bb-4dc3-9a71-776c224ba808', 'volume_name': 'volume-220640a4-e3bb-4dc3-9a71-776c224ba808', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (482e7b4f-18be-45e3-bce0-ab2007771ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (482e7b4f-18be-45e3-bce0-ab2007771ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30a5f7e7-3ac7-40fb-a011-bb19d8b3651f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:18 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] Volume 220640a4-e3bb-4dc3-9a71-776c224ba808: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-220640a4-e3bb-4dc3-9a71-776c224ba808', 'volume_size': 1} Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1876630277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=220640a4-e3bb-4dc3-9a71-776c224ba808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d02321bebfb0498caeea9f99ab45ad75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:21:18Z,use_quota=True,user_id='31efb884c51d4bfd8eb841407a15c772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] Creating volume 220640a4-e3bb-4dc3-9a71-776c224ba808 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:21:18 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-220640a4-e3bb-4dc3-9a71-776c224ba808 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:18 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-220640a4-e3bb-4dc3-9a71-776c224ba808 1073741824 Nov 03 13:21:18 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:18 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-054617c8-5cba-45da-b370-ca5016496a3d tempest-VolumesMetadataTest-1891170323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.279s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-054617c8-5cba-45da-b370-ca5016496a3d tempest-VolumesMetadataTest-1891170323 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:21:18 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-054617c8-5cba-45da-b370-ca5016496a3d tempest-VolumesMetadataTest-1891170323 None] Deleted volume successfully. Nov 03 13:21:18 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-054617c8-5cba-45da-b370-ca5016496a3d tempest-VolumesMetadataTest-1891170323 None] Lock "cinder-a380f3db-5530-4de6-93bd-2426b709290f-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:19 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-220640a4-e3bb-4dc3-9a71-776c224ba808 1073741824" returned: 0 in 0.512s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-220640a4-e3bb-4dc3-9a71-776c224ba808 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:19 devstack sudo[102230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-220640a4-e3bb-4dc3-9a71-776c224ba808 Nov 03 13:21:19 devstack sudo[102230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:19 devstack sudo[102230]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-220640a4-e3bb-4dc3-9a71-776c224ba808" returned: 0 in 0.285s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:19 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:21:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:19 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30a5f7e7-3ac7-40fb-a011-bb19d8b3651f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-220640a4-e3bb-4dc3-9a71-776c224ba808', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:19 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1abab574-6eac-49c1-a041-8991396e4388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:19 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] Volume volume-220640a4-e3bb-4dc3-9a71-776c224ba808 (220640a4-e3bb-4dc3-9a71-776c224ba808): created successfully Nov 03 13:21:19 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1abab574-6eac-49c1-a041-8991396e4388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:19 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] Flow 'volume_create_manager' (9ed1589a-bf17-4825-8749-255e6444e201) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:21:19 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-48f077f9-139c-40cd-9ca9-e57d01e4f93c tempest-ProjectReaderTests-596586335 None] Created volume successfully. Nov 03 13:21:20 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-eb0d33a6-43c4-462f-a7d6-9a9e4f511cb4 tempest-ProjectReaderTests-596586335 None] Acquiring lock "cinder-220640a4-e3bb-4dc3-9a71-776c224ba808-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:20 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-eb0d33a6-43c4-462f-a7d6-9a9e4f511cb4 tempest-ProjectReaderTests-596586335 None] Lock "cinder-220640a4-e3bb-4dc3-9a71-776c224ba808-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:20 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-eb0d33a6-43c4-462f-a7d6-9a9e4f511cb4 tempest-ProjectReaderTests-596586335 None] Acquiring lock "cinder-quobyte-220640a4-e3bb-4dc3-9a71-776c224ba808" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:20 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-eb0d33a6-43c4-462f-a7d6-9a9e4f511cb4 tempest-ProjectReaderTests-596586335 None] Lock "cinder-quobyte-220640a4-e3bb-4dc3-9a71-776c224ba808" acquired by "delete_volume" :: waited 0.023s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:20 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4189c94-513e-47f8-b9e0-56e0ce039ef2]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:21:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-eb0d33a6-43c4-462f-a7d6-9a9e4f511cb4 tempest-ProjectReaderTests-596586335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-220640a4-e3bb-4dc3-9a71-776c224ba808 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:20 devstack sudo[102233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-220640a4-e3bb-4dc3-9a71-776c224ba808 Nov 03 13:21:20 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:21 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-eb0d33a6-43c4-462f-a7d6-9a9e4f511cb4 tempest-ProjectReaderTests-596586335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-220640a4-e3bb-4dc3-9a71-776c224ba808" returned: 0 in 0.441s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-eb0d33a6-43c4-462f-a7d6-9a9e4f511cb4 tempest-ProjectReaderTests-596586335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-220640a4-e3bb-4dc3-9a71-776c224ba808 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:21 devstack sudo[102239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-220640a4-e3bb-4dc3-9a71-776c224ba808 Nov 03 13:21:21 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:21 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-eb0d33a6-43c4-462f-a7d6-9a9e4f511cb4 tempest-ProjectReaderTests-596586335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-220640a4-e3bb-4dc3-9a71-776c224ba808" returned: 0 in 0.289s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:21 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-eb0d33a6-43c4-462f-a7d6-9a9e4f511cb4 tempest-ProjectReaderTests-596586335 None] Lock "cinder-quobyte-220640a4-e3bb-4dc3-9a71-776c224ba808" released by "delete_volume" :: held 0.792s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:21 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-eb0d33a6-43c4-462f-a7d6-9a9e4f511cb4 tempest-ProjectReaderTests-596586335 None] Created reservations ['2c13eb22-4106-48f4-8bb6-0136d82e0367', '3f18a7b9-d9c9-4a73-b2ee-203f514b4ef1', 'f466197d-dc7a-45c2-bd9e-6203440665b6', '929fa985-1a9e-48b8-9a08-c9f7bcfd004b'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:21:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-eb0d33a6-43c4-462f-a7d6-9a9e4f511cb4 tempest-ProjectReaderTests-596586335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-eb0d33a6-43c4-462f-a7d6-9a9e4f511cb4 tempest-ProjectReaderTests-596586335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:21 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-eb0d33a6-43c4-462f-a7d6-9a9e4f511cb4 tempest-ProjectReaderTests-596586335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:21 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-eb0d33a6-43c4-462f-a7d6-9a9e4f511cb4 tempest-ProjectReaderTests-596586335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-eb0d33a6-43c4-462f-a7d6-9a9e4f511cb4 tempest-ProjectReaderTests-596586335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-eb0d33a6-43c4-462f-a7d6-9a9e4f511cb4 tempest-ProjectReaderTests-596586335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:21 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:21:21 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:21 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-eb0d33a6-43c4-462f-a7d6-9a9e4f511cb4 tempest-ProjectReaderTests-596586335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.282s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:21 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-eb0d33a6-43c4-462f-a7d6-9a9e4f511cb4 tempest-ProjectReaderTests-596586335 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:21:21 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-eb0d33a6-43c4-462f-a7d6-9a9e4f511cb4 tempest-ProjectReaderTests-596586335 None] Deleted volume successfully. Nov 03 13:21:22 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-eb0d33a6-43c4-462f-a7d6-9a9e4f511cb4 tempest-ProjectReaderTests-596586335 None] Lock "cinder-220640a4-e3bb-4dc3-9a71-776c224ba808-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:22 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:21:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] Flow 'volume_create_manager' (473bfaa7-630a-474d-86c0-3d26f647fcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:21:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5af1438-cc8f-4d2e-9113-ab5e51646af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5af1438-cc8f-4d2e-9113-ab5e51646af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-929664478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66e68125-d85f-465b-908b-c28fd02385a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d02321bebfb0498caeea9f99ab45ad75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:21:22Z,use_quota=True,user_id='31efb884c51d4bfd8eb841407a15c772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5938b5d0-6810-4dc7-bec1-2a740e1cff6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5938b5d0-6810-4dc7-bec1-2a740e1cff6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceda7db4-c7e7-4117-adff-80339b1d8fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceda7db4-c7e7-4117-adff-80339b1d8fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66e68125-d85f-465b-908b-c28fd02385a2', 'volume_name': 'volume-66e68125-d85f-465b-908b-c28fd02385a2', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ac9cb1e-45bf-45fd-be8e-c3e5010796bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ac9cb1e-45bf-45fd-be8e-c3e5010796bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9473d0fc-794b-4646-857a-44660ae75e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:22 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] Volume 66e68125-d85f-465b-908b-c28fd02385a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66e68125-d85f-465b-908b-c28fd02385a2', 'volume_size': 1} Nov 03 13:21:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:22 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-929664478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66e68125-d85f-465b-908b-c28fd02385a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d02321bebfb0498caeea9f99ab45ad75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:21:22Z,use_quota=True,user_id='31efb884c51d4bfd8eb841407a15c772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:21:22 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] Creating volume 66e68125-d85f-465b-908b-c28fd02385a2 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:21:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:22 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:22 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:22 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:21:22 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:21:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66e68125-d85f-465b-908b-c28fd02385a2 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:22 devstack sudo[102247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66e68125-d85f-465b-908b-c28fd02385a2 1073741824 Nov 03 13:21:22 devstack sudo[102247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:23 devstack sudo[102247]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66e68125-d85f-465b-908b-c28fd02385a2 1073741824" returned: 0 in 0.527s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66e68125-d85f-465b-908b-c28fd02385a2 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:23 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66e68125-d85f-465b-908b-c28fd02385a2 Nov 03 13:21:23 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:23 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:21:23 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Flow 'volume_create_manager' (7f2055b9-ac19-4de5-b2e9-db6054597cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:21:23 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f09a1f-2db9-49f2-b2ec-afc69881b93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:23 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f09a1f-2db9-49f2-b2ec-afc69881b93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-534648036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c5ff8c-11f8-4b9a-97af-593172517a15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8472edc4ba4b42c2a1bad9509d25de74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:21:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:21:23Z,use_quota=True,user_id='a5e39f3ad4e2495aa44c8ba07f63aca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:23 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8924b55f-3622-471b-8cef-784a0b38647a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:23 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8924b55f-3622-471b-8cef-784a0b38647a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:23 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b8dbcdb-d42c-4630-944b-00a82bc6df78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:23 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b8dbcdb-d42c-4630-944b-00a82bc6df78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3c5ff8c-11f8-4b9a-97af-593172517a15', 'volume_name': 'volume-e3c5ff8c-11f8-4b9a-97af-593172517a15', 'volume_size': 2}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:23 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9500ace0-e59b-48fc-9d97-0755c9287f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:23 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9500ace0-e59b-48fc-9d97-0755c9287f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:23 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd6e7c44-26e3-4e54-869d-11591045b9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:23 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Volume e3c5ff8c-11f8-4b9a-97af-593172517a15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3c5ff8c-11f8-4b9a-97af-593172517a15', 'volume_size': 2} Nov 03 13:21:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:23 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66e68125-d85f-465b-908b-c28fd02385a2" returned: 0 in 0.332s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:23 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:21:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.020s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:23 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-534648036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c5ff8c-11f8-4b9a-97af-593172517a15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8472edc4ba4b42c2a1bad9509d25de74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:21:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:21:23Z,use_quota=True,user_id='a5e39f3ad4e2495aa44c8ba07f63aca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:21:23 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Creating volume e3c5ff8c-11f8-4b9a-97af-593172517a15 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:21:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:23 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:23 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:23 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:21:23 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:21:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15 2147483648 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:23 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9473d0fc-794b-4646-857a-44660ae75e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66e68125-d85f-465b-908b-c28fd02385a2', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:23 devstack sudo[102256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15 2147483648 Nov 03 13:21:23 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:23 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fe34dab-d62b-417b-91f6-59e4dd538157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:23 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] Volume volume-66e68125-d85f-465b-908b-c28fd02385a2 (66e68125-d85f-465b-908b-c28fd02385a2): created successfully Nov 03 13:21:23 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fe34dab-d62b-417b-91f6-59e4dd538157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:23 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] Flow 'volume_create_manager' (473bfaa7-630a-474d-86c0-3d26f647fcb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:21:23 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-a68567c2-c5de-44e5-82f9-92ecfb4e3f04 tempest-ProjectReaderTests-596586335 None] Created volume successfully. Nov 03 13:21:23 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15 2147483648" returned: 0 in 0.489s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:24 devstack sudo[102262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15 Nov 03 13:21:24 devstack sudo[102262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:24 devstack sudo[102262]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15" returned: 0 in 0.270s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:24 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:21:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd6e7c44-26e3-4e54-869d-11591045b9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3c5ff8c-11f8-4b9a-97af-593172517a15', 'volume_size': 2}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19e58dbc-ed76-4565-8d55-e74fce942b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:24 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Volume volume-e3c5ff8c-11f8-4b9a-97af-593172517a15 (e3c5ff8c-11f8-4b9a-97af-593172517a15): created successfully Nov 03 13:21:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19e58dbc-ed76-4565-8d55-e74fce942b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Flow 'volume_create_manager' (7f2055b9-ac19-4de5-b2e9-db6054597cb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:21:24 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-f1d15b03-6642-4c8d-9959-48b6d1719dad tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Created volume successfully. Nov 03 13:21:24 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3edc4cdf-c8e9-423e-8ae0-0b2958d97ebc tempest-ProjectReaderTests-596586335 None] Acquiring lock "cinder-66e68125-d85f-465b-908b-c28fd02385a2-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:24 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3edc4cdf-c8e9-423e-8ae0-0b2958d97ebc tempest-ProjectReaderTests-596586335 None] Lock "cinder-66e68125-d85f-465b-908b-c28fd02385a2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:24 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3edc4cdf-c8e9-423e-8ae0-0b2958d97ebc tempest-ProjectReaderTests-596586335 None] Acquiring lock "cinder-quobyte-66e68125-d85f-465b-908b-c28fd02385a2" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:24 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3edc4cdf-c8e9-423e-8ae0-0b2958d97ebc tempest-ProjectReaderTests-596586335 None] Lock "cinder-quobyte-66e68125-d85f-465b-908b-c28fd02385a2" acquired by "delete_volume" :: waited 0.018s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:24 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[595d48b5-a30e-4967-b690-45e10e3b492c]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:21:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3edc4cdf-c8e9-423e-8ae0-0b2958d97ebc tempest-ProjectReaderTests-596586335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66e68125-d85f-465b-908b-c28fd02385a2 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:24 devstack sudo[102265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66e68125-d85f-465b-908b-c28fd02385a2 Nov 03 13:21:24 devstack sudo[102265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:25 devstack sudo[102265]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3edc4cdf-c8e9-423e-8ae0-0b2958d97ebc tempest-ProjectReaderTests-596586335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66e68125-d85f-465b-908b-c28fd02385a2" returned: 0 in 0.407s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3edc4cdf-c8e9-423e-8ae0-0b2958d97ebc tempest-ProjectReaderTests-596586335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66e68125-d85f-465b-908b-c28fd02385a2 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:25 devstack sudo[102270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66e68125-d85f-465b-908b-c28fd02385a2 Nov 03 13:21:25 devstack sudo[102270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:25 devstack sudo[102270]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3edc4cdf-c8e9-423e-8ae0-0b2958d97ebc tempest-ProjectReaderTests-596586335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66e68125-d85f-465b-908b-c28fd02385a2" returned: 0 in 0.270s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3edc4cdf-c8e9-423e-8ae0-0b2958d97ebc tempest-ProjectReaderTests-596586335 None] Lock "cinder-quobyte-66e68125-d85f-465b-908b-c28fd02385a2" released by "delete_volume" :: held 0.730s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:25 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-3edc4cdf-c8e9-423e-8ae0-0b2958d97ebc tempest-ProjectReaderTests-596586335 None] Created reservations ['9f40827b-58cc-4ef0-9d99-c297048da620', '9e021875-ef59-4e31-a40e-f311e7f14f6f', 'c09db3c9-fb66-4bb4-8242-8f025b82b4f1', '120a36bc-7149-42db-a120-1875fbfdb565'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:21:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3edc4cdf-c8e9-423e-8ae0-0b2958d97ebc tempest-ProjectReaderTests-596586335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3edc4cdf-c8e9-423e-8ae0-0b2958d97ebc tempest-ProjectReaderTests-596586335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3edc4cdf-c8e9-423e-8ae0-0b2958d97ebc tempest-ProjectReaderTests-596586335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3edc4cdf-c8e9-423e-8ae0-0b2958d97ebc tempest-ProjectReaderTests-596586335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3edc4cdf-c8e9-423e-8ae0-0b2958d97ebc tempest-ProjectReaderTests-596586335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3edc4cdf-c8e9-423e-8ae0-0b2958d97ebc tempest-ProjectReaderTests-596586335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:25 devstack sudo[102273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:21:25 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8787857e-ae17-49ed-b894-0422e30297b2 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8787857e-ae17-49ed-b894-0422e30297b2 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-8787857e-ae17-49ed-b894-0422e30297b2 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Creating offline snapshot c8e3fa20-de11-436a-a20d-a3abadedb7aa of volume e3c5ff8c-11f8-4b9a-97af-593172517a15 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:21:25 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cbe644-375c-42ac-8a3f-0f7bb5e99643]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:21:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8787857e-ae17-49ed-b894-0422e30297b2 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:25 devstack sudo[102275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15 Nov 03 13:21:25 devstack sudo[102275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:25 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3edc4cdf-c8e9-423e-8ae0-0b2958d97ebc tempest-ProjectReaderTests-596586335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.277s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:25 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3edc4cdf-c8e9-423e-8ae0-0b2958d97ebc tempest-ProjectReaderTests-596586335 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:21:25 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-3edc4cdf-c8e9-423e-8ae0-0b2958d97ebc tempest-ProjectReaderTests-596586335 None] Deleted volume successfully. Nov 03 13:21:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3edc4cdf-c8e9-423e-8ae0-0b2958d97ebc tempest-ProjectReaderTests-596586335 None] Lock "cinder-66e68125-d85f-465b-908b-c28fd02385a2-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:26 devstack sudo[102275]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8787857e-ae17-49ed-b894-0422e30297b2 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15" returned: 0 in 0.447s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8787857e-ae17-49ed-b894-0422e30297b2 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15.c8e3fa20-de11-436a-a20d-a3abadedb7aa 2G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:26 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15.c8e3fa20-de11-436a-a20d-a3abadedb7aa 2G Nov 03 13:21:26 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:26 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:21:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] Flow 'volume_create_manager' (3187b8c5-ec7c-4850-98b1-e524a599d1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:21:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f97821a-9adb-428b-b5d9-f7a99d1a0b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f97821a-9adb-428b-b5d9-f7a99d1a0b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1195794301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62caca6f-6a77-4cc3-b3d2-d5b45b21a47c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d02321bebfb0498caeea9f99ab45ad75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:21:26Z,use_quota=True,user_id='31efb884c51d4bfd8eb841407a15c772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbee8012-2820-4a92-83d2-d22a9d7c9b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbee8012-2820-4a92-83d2-d22a9d7c9b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbade0b4-ad7e-4510-9d80-23d80d9c35f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbade0b4-ad7e-4510-9d80-23d80d9c35f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62caca6f-6a77-4cc3-b3d2-d5b45b21a47c', 'volume_name': 'volume-62caca6f-6a77-4cc3-b3d2-d5b45b21a47c', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d20f6ad-f452-4fee-ba76-acef32850be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d20f6ad-f452-4fee-ba76-acef32850be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84cdcc89-0882-4140-87a9-ffd4e058b108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:26 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] Volume 62caca6f-6a77-4cc3-b3d2-d5b45b21a47c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62caca6f-6a77-4cc3-b3d2-d5b45b21a47c', 'volume_size': 1} Nov 03 13:21:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:26 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8787857e-ae17-49ed-b894-0422e30297b2 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15.c8e3fa20-de11-436a-a20d-a3abadedb7aa 2G" returned: 0 in 0.463s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8787857e-ae17-49ed-b894-0422e30297b2 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3c5ff8c-11f8-4b9a-97af-593172517a15 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15.c8e3fa20-de11-436a-a20d-a3abadedb7aa {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:26 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3c5ff8c-11f8-4b9a-97af-593172517a15 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15.c8e3fa20-de11-436a-a20d-a3abadedb7aa Nov 03 13:21:26 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:26 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8787857e-ae17-49ed-b894-0422e30297b2 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3c5ff8c-11f8-4b9a-97af-593172517a15 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15.c8e3fa20-de11-436a-a20d-a3abadedb7aa" returned: 0 in 0.302s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:26 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-8787857e-ae17-49ed-b894-0422e30297b2 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15.c8e3fa20-de11-436a-a20d-a3abadedb7aa is being set with open permissions: ugo+rw Nov 03 13:21:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8787857e-ae17-49ed-b894-0422e30297b2 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15.c8e3fa20-de11-436a-a20d-a3abadedb7aa {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:26 devstack sudo[102293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15.c8e3fa20-de11-436a-a20d-a3abadedb7aa Nov 03 13:21:26 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:27 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8787857e-ae17-49ed-b894-0422e30297b2 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15.c8e3fa20-de11-436a-a20d-a3abadedb7aa" returned: 0 in 0.252s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8787857e-ae17-49ed-b894-0422e30297b2 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:27 devstack sudo[102296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15.info Nov 03 13:21:27 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:27 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8787857e-ae17-49ed-b894-0422e30297b2 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15.info" returned: 0 in 0.274s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:27 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-8787857e-ae17-49ed-b894-0422e30297b2 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15.info is being set with open permissions: ugo+rw Nov 03 13:21:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8787857e-ae17-49ed-b894-0422e30297b2 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:27 devstack sudo[102299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15.info Nov 03 13:21:27 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:27 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8787857e-ae17-49ed-b894-0422e30297b2 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15.info" returned: 0 in 0.257s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8787857e-ae17-49ed-b894-0422e30297b2 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.086s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.306s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:27 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1195794301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62caca6f-6a77-4cc3-b3d2-d5b45b21a47c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d02321bebfb0498caeea9f99ab45ad75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:21:26Z,use_quota=True,user_id='31efb884c51d4bfd8eb841407a15c772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:21:27 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] Creating volume 62caca6f-6a77-4cc3-b3d2-d5b45b21a47c {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:21:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:27 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:27 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:27 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:21:27 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:21:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62caca6f-6a77-4cc3-b3d2-d5b45b21a47c 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:27 devstack sudo[102302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62caca6f-6a77-4cc3-b3d2-d5b45b21a47c 1073741824 Nov 03 13:21:27 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:27 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-8787857e-ae17-49ed-b894-0422e30297b2 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Create snapshot completed successfully Nov 03 13:21:28 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62caca6f-6a77-4cc3-b3d2-d5b45b21a47c 1073741824" returned: 0 in 0.494s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62caca6f-6a77-4cc3-b3d2-d5b45b21a47c {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:28 devstack sudo[102310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62caca6f-6a77-4cc3-b3d2-d5b45b21a47c Nov 03 13:21:28 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:28 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62caca6f-6a77-4cc3-b3d2-d5b45b21a47c" returned: 0 in 0.294s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:28 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:21:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:28 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:21:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Flow 'volume_create_manager' (3cc2ade2-251a-42f2-909d-f78ca7b16eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:21:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (677803d8-689b-401a-b3e1-5d1d866eda82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84cdcc89-0882-4140-87a9-ffd4e058b108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62caca6f-6a77-4cc3-b3d2-d5b45b21a47c', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (682852f0-9333-410e-be75-f3959729e131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (677803d8-689b-401a-b3e1-5d1d866eda82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07fa4328-07bf-4625-b617-b4544707e205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6fda07540249adb00a882967b11966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:21:29Z,use_quota=True,user_id='6819ea1801d4474e83474db9536a1c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5dddcf7b-724e-425b-b37a-64feed27c4ed),volume_type_id=5dddcf7b-724e-425b-b37a-64feed27c4ed)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fb85416-8a1a-4207-aaf3-9c0bdd2446f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fb85416-8a1a-4207-aaf3-9c0bdd2446f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1279e8d4-9b87-45a4-bf4d-2a005344feb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:28 devstack cinder-volume[86725]: DEBUG cinder.image.glance [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Creating Keystone auth plugin from conf {{(pid=86725) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 13:21:28 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] Volume volume-62caca6f-6a77-4cc3-b3d2-d5b45b21a47c (62caca6f-6a77-4cc3-b3d2-d5b45b21a47c): created successfully Nov 03 13:21:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (682852f0-9333-410e-be75-f3959729e131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] Flow 'volume_create_manager' (3187b8c5-ec7c-4850-98b1-e524a599d1c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:21:28 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-3597acac-8116-486c-bc36-519f9c3f5259 tempest-ProjectReaderTests-596586335 None] Created volume successfully. Nov 03 13:21:28 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4b3323a9-7580-464c-9774-fe2bc2060410 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Acquiring lock "cinder-c8e3fa20-de11-436a-a20d-a3abadedb7aa-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:28 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4b3323a9-7580-464c-9774-fe2bc2060410 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Lock "cinder-c8e3fa20-de11-436a-a20d-a3abadedb7aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:28 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4b3323a9-7580-464c-9774-fe2bc2060410 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Acquiring lock "cinder-quobyte-e3c5ff8c-11f8-4b9a-97af-593172517a15" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:28 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4b3323a9-7580-464c-9774-fe2bc2060410 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Lock "cinder-quobyte-e3c5ff8c-11f8-4b9a-97af-593172517a15" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:28 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4b3323a9-7580-464c-9774-fe2bc2060410 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Acquiring lock "cinder-quobyte-c8e3fa20-de11-436a-a20d-a3abadedb7aa" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:28 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4b3323a9-7580-464c-9774-fe2bc2060410 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Lock "cinder-quobyte-c8e3fa20-de11-436a-a20d-a3abadedb7aa" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:28 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-4b3323a9-7580-464c-9774-fe2bc2060410 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Deleting offline snapshot c8e3fa20-de11-436a-a20d-a3abadedb7aa of volume e3c5ff8c-11f8-4b9a-97af-593172517a15 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:21:28 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-4b3323a9-7580-464c-9774-fe2bc2060410 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] snapshot_file for this snap is: volume-e3c5ff8c-11f8-4b9a-97af-593172517a15.c8e3fa20-de11-436a-a20d-a3abadedb7aa {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:21:28 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[249848cf-dac3-49e5-afb7-c44c5fe44a66]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:21:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4b3323a9-7580-464c-9774-fe2bc2060410 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15.c8e3fa20-de11-436a-a20d-a3abadedb7aa {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1279e8d4-9b87-45a4-bf4d-2a005344feb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '07fa4328-07bf-4625-b617-b4544707e205', 'volume_name': 'volume-07fa4328-07bf-4625-b617-b4544707e205', 'volume_size': 1, 'image_id': '98519bbd-c638-438b-821c-975d2da29f4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/98519bbd-c638-438b-821c-975d2da29f4f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'edc0010eaa0c9489ea47bcd4e0f31c86', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ae6fda07540249adb00a882967b11966', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0d6e93e3215499905384ba5e2e38fc3c3946d16be6fcf35bb03690b00a25b1faf855147b8a744fe8a53c4dd220c4e79025a043403ce26ad7ffc98fd608178088', 'id': '98519bbd-c638-438b-821c-975d2da29f4f', 'created_at': datetime.datetime(2026, 11, 3, 12, 21, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 21, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98519bbd-c638-438b-821c-975d2da29f4f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd306f07-b0cf-4bfe-b87e-756982a8d6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd306f07-b0cf-4bfe-b87e-756982a8d6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a8508a7-ff2f-45e6-abe5-54dbb439f8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:28 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Volume 07fa4328-07bf-4625-b617-b4544707e205: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-07fa4328-07bf-4625-b617-b4544707e205', 'volume_size': 1, 'image_id': '98519bbd-c638-438b-821c-975d2da29f4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/98519bbd-c638-438b-821c-975d2da29f4f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'edc0010eaa0c9489ea47bcd4e0f31c86', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ae6fda07540249adb00a882967b11966', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0d6e93e3215499905384ba5e2e38fc3c3946d16be6fcf35bb03690b00a25b1faf855147b8a744fe8a53c4dd220c4e79025a043403ce26ad7ffc98fd608178088', 'id': '98519bbd-c638-438b-821c-975d2da29f4f', 'created_at': datetime.datetime(2026, 11, 3, 12, 21, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 21, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98519bbd-c638-438b-821c-975d2da29f4f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 03 13:21:28 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Trying to clone 07fa4328-07bf-4625-b617-b4544707e205 from image 98519bbd-c638-438b-821c-975d2da29f4f at location (None, [{'url': 'file:///opt/stack/data/glance/images/98519bbd-c638-438b-821c-975d2da29f4f', 'metadata': {}}]). {{(pid=86725) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 13:21:29 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15.c8e3fa20-de11-436a-a20d-a3abadedb7aa Nov 03 13:21:29 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:29 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_98519bbd-c638-438b-821c-975d2da29f4f_gv3y0o97devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86725) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 13:21:29 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Image download 0.00 MB at 0.00 MB/s Nov 03 13:21:29 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd68d0f-6b1a-4dc5-84cd-d8279367bd02]: (4, 'raw') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:21:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_98519bbd-c638-438b-821c-975d2da29f4f_gv3y0o97devstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:29 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_98519bbd-c638-438b-821c-975d2da29f4f_gv3y0o97devstack@QuobyteHD Nov 03 13:21:29 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:29 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4b3323a9-7580-464c-9774-fe2bc2060410 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15.c8e3fa20-de11-436a-a20d-a3abadedb7aa" returned: 0 in 0.368s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:29 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-4b3323a9-7580-464c-9774-fe2bc2060410 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3c5ff8c-11f8-4b9a-97af-593172517a15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:21:29 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7152923-627d-429b-b824-0be17a7c1da3]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:21:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4b3323a9-7580-464c-9774-fe2bc2060410 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:29 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15 Nov 03 13:21:29 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:29 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:29 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8934b119-73fd-4809-b573-40530c69ed0a tempest-ProjectReaderTests-596586335 None] Acquiring lock "cinder-62caca6f-6a77-4cc3-b3d2-d5b45b21a47c-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_98519bbd-c638-438b-821c-975d2da29f4f_gv3y0o97devstack@QuobyteHD" returned: 0 in 0.377s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98519bbd-c638-438b-821c-975d2da29f4f_gv3y0o97devstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:29 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8934b119-73fd-4809-b573-40530c69ed0a tempest-ProjectReaderTests-596586335 None] Lock "cinder-62caca6f-6a77-4cc3-b3d2-d5b45b21a47c-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:29 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8934b119-73fd-4809-b573-40530c69ed0a tempest-ProjectReaderTests-596586335 None] Acquiring lock "cinder-quobyte-62caca6f-6a77-4cc3-b3d2-d5b45b21a47c" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:29 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8934b119-73fd-4809-b573-40530c69ed0a tempest-ProjectReaderTests-596586335 None] Lock "cinder-quobyte-62caca6f-6a77-4cc3-b3d2-d5b45b21a47c" acquired by "delete_volume" :: waited 0.022s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:29 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[b759674f-fc5c-4761-b9b1-f7f5070980a0]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:21:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8934b119-73fd-4809-b573-40530c69ed0a tempest-ProjectReaderTests-596586335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62caca6f-6a77-4cc3-b3d2-d5b45b21a47c {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:29 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98519bbd-c638-438b-821c-975d2da29f4f_gv3y0o97devstack@QuobyteHD Nov 03 13:21:29 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:29 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4b3323a9-7580-464c-9774-fe2bc2060410 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15" returned: 0 in 0.440s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4b3323a9-7580-464c-9774-fe2bc2060410 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15.c8e3fa20-de11-436a-a20d-a3abadedb7aa {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:29 devstack sudo[102325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62caca6f-6a77-4cc3-b3d2-d5b45b21a47c Nov 03 13:21:29 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:29 devstack sudo[102330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15.c8e3fa20-de11-436a-a20d-a3abadedb7aa Nov 03 13:21:29 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:29 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98519bbd-c638-438b-821c-975d2da29f4f_gv3y0o97devstack@QuobyteHD" returned: 1 in 0.378s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98519bbd-c638-438b-821c-975d2da29f4f_gv3y0o97devstack@QuobyteHD' failed. Not Retrying. {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:21:29 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Temporary image 98519bbd-c638-438b-821c-975d2da29f4f is fetched for user 6819ea1801d4474e83474db9536a1c84. {{(pid=86725) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 13:21:29 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d0e381-982f-401d-aefd-79c734c97757]: (4, 'raw') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:21:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_98519bbd-c638-438b-821c-975d2da29f4f_gv3y0o97devstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:30 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8934b119-73fd-4809-b573-40530c69ed0a tempest-ProjectReaderTests-596586335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62caca6f-6a77-4cc3-b3d2-d5b45b21a47c" returned: 0 in 0.413s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8934b119-73fd-4809-b573-40530c69ed0a tempest-ProjectReaderTests-596586335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62caca6f-6a77-4cc3-b3d2-d5b45b21a47c {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:30 devstack sudo[102343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62caca6f-6a77-4cc3-b3d2-d5b45b21a47c Nov 03 13:21:30 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:30 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_98519bbd-c638-438b-821c-975d2da29f4f_gv3y0o97devstack@QuobyteHD Nov 03 13:21:30 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:30 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4b3323a9-7580-464c-9774-fe2bc2060410 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15.c8e3fa20-de11-436a-a20d-a3abadedb7aa" returned: 0 in 0.356s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4b3323a9-7580-464c-9774-fe2bc2060410 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15.c8e3fa20-de11-436a-a20d-a3abadedb7aa {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:30 devstack sudo[102346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15.c8e3fa20-de11-436a-a20d-a3abadedb7aa Nov 03 13:21:30 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:30 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8934b119-73fd-4809-b573-40530c69ed0a tempest-ProjectReaderTests-596586335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62caca6f-6a77-4cc3-b3d2-d5b45b21a47c" returned: 0 in 0.260s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:30 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_98519bbd-c638-438b-821c-975d2da29f4f_gv3y0o97devstack@QuobyteHD" returned: 0 in 0.364s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98519bbd-c638-438b-821c-975d2da29f4f_gv3y0o97devstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8934b119-73fd-4809-b573-40530c69ed0a tempest-ProjectReaderTests-596586335 None] Lock "cinder-quobyte-62caca6f-6a77-4cc3-b3d2-d5b45b21a47c" released by "delete_volume" :: held 0.731s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:30 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4b3323a9-7580-464c-9774-fe2bc2060410 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15.c8e3fa20-de11-436a-a20d-a3abadedb7aa" returned: 0 in 0.264s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-8934b119-73fd-4809-b573-40530c69ed0a tempest-ProjectReaderTests-596586335 None] Created reservations ['f1b80dba-029e-4024-bc48-ad469d70b02a', '435675a5-b525-470b-9422-deb5a7642c6e', '1a19da10-290e-4e36-86f6-f278d7bdf685', '47e44e51-10be-4768-a287-11bc61bb7671'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4b3323a9-7580-464c-9774-fe2bc2060410 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Lock "cinder-quobyte-c8e3fa20-de11-436a-a20d-a3abadedb7aa" released by "_delete_snapshot" :: held 1.561s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4b3323a9-7580-464c-9774-fe2bc2060410 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Lock "cinder-quobyte-e3c5ff8c-11f8-4b9a-97af-593172517a15" released by "delete_snapshot" :: held 1.587s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:30 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98519bbd-c638-438b-821c-975d2da29f4f_gv3y0o97devstack@QuobyteHD Nov 03 13:21:30 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8934b119-73fd-4809-b573-40530c69ed0a tempest-ProjectReaderTests-596586335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8934b119-73fd-4809-b573-40530c69ed0a tempest-ProjectReaderTests-596586335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-8934b119-73fd-4809-b573-40530c69ed0a tempest-ProjectReaderTests-596586335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-8934b119-73fd-4809-b573-40530c69ed0a tempest-ProjectReaderTests-596586335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8934b119-73fd-4809-b573-40530c69ed0a tempest-ProjectReaderTests-596586335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8934b119-73fd-4809-b573-40530c69ed0a tempest-ProjectReaderTests-596586335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:30 devstack sudo[102354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-4b3323a9-7580-464c-9774-fe2bc2060410 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Created reservations ['ae815196-9714-47ce-8f62-fda872c3bc17', '82051fa3-1360-4fc1-9081-d7a59aa3b11b', 'afa847fa-36d7-4f85-9f88-b9182589f804', '980d9647-2de8-40e6-af4d-0b909af57567'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:21:30 devstack sudo[102354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:30 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-4b3323a9-7580-464c-9774-fe2bc2060410 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Delete snapshot completed successfully. Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4b3323a9-7580-464c-9774-fe2bc2060410 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Lock "cinder-c8e3fa20-de11-436a-a20d-a3abadedb7aa-delete_snapshot" released by "delete_snapshot" :: held 1.789s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:30 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98519bbd-c638-438b-821c-975d2da29f4f_gv3y0o97devstack@QuobyteHD" returned: 1 in 0.384s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98519bbd-c638-438b-821c-975d2da29f4f_gv3y0o97devstack@QuobyteHD' failed. Not Retrying. {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07fa4328-07bf-4625-b617-b4544707e205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6fda07540249adb00a882967b11966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:21:29Z,use_quota=True,user_id='6819ea1801d4474e83474db9536a1c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5dddcf7b-724e-425b-b37a-64feed27c4ed),volume_type_id=5dddcf7b-724e-425b-b37a-64feed27c4ed)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Creating volume 07fa4328-07bf-4625-b617-b4544707e205 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:21:30 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-07fa4328-07bf-4625-b617-b4544707e205 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:30 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-07fa4328-07bf-4625-b617-b4544707e205 1073741824 Nov 03 13:21:30 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:30 devstack sudo[102354]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8934b119-73fd-4809-b573-40530c69ed0a tempest-ProjectReaderTests-596586335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.310s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-8934b119-73fd-4809-b573-40530c69ed0a tempest-ProjectReaderTests-596586335 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:21:30 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-8934b119-73fd-4809-b573-40530c69ed0a tempest-ProjectReaderTests-596586335 None] Deleted volume successfully. Nov 03 13:21:30 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8934b119-73fd-4809-b573-40530c69ed0a tempest-ProjectReaderTests-596586335 None] Lock "cinder-62caca6f-6a77-4cc3-b3d2-d5b45b21a47c-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:31 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e8b0c17b-a07d-48f9-8c16-0b81ea2f1706 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Acquiring lock "cinder-e3c5ff8c-11f8-4b9a-97af-593172517a15-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:31 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e8b0c17b-a07d-48f9-8c16-0b81ea2f1706 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Lock "cinder-e3c5ff8c-11f8-4b9a-97af-593172517a15-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:31 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e8b0c17b-a07d-48f9-8c16-0b81ea2f1706 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Acquiring lock "cinder-quobyte-e3c5ff8c-11f8-4b9a-97af-593172517a15" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:31 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e8b0c17b-a07d-48f9-8c16-0b81ea2f1706 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Lock "cinder-quobyte-e3c5ff8c-11f8-4b9a-97af-593172517a15" acquired by "delete_volume" :: waited 0.022s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:31 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[887af296-726c-4336-80b0-102d1e774434]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:21:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e8b0c17b-a07d-48f9-8c16-0b81ea2f1706 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:31 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-07fa4328-07bf-4625-b617-b4544707e205 1073741824" returned: 0 in 0.521s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-07fa4328-07bf-4625-b617-b4544707e205 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:31 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-07fa4328-07bf-4625-b617-b4544707e205 Nov 03 13:21:31 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:31 devstack sudo[102366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15 Nov 03 13:21:31 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:31 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-07fa4328-07bf-4625-b617-b4544707e205" returned: 0 in 0.282s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:31 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:21:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:31 devstack cinder-volume[86725]: DEBUG cinder.volume.volume_utils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Attempting download of 98519bbd-c638-438b-821c-975d2da29f4f ((None, [{'url': 'file:///opt/stack/data/glance/images/98519bbd-c638-438b-821c-975d2da29f4f', 'metadata': {}}])) to volume 07fa4328-07bf-4625-b617-b4544707e205. {{(pid=86725) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 13:21:31 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e8b0c17b-a07d-48f9-8c16-0b81ea2f1706 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15" returned: 0 in 0.403s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e8b0c17b-a07d-48f9-8c16-0b81ea2f1706 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:31 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15 Nov 03 13:21:31 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c7c8dd-d93d-47df-abbc-abf6c113b567]: (4, 'raw') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:21:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_98519bbd-c638-438b-821c-975d2da29f4f_98gwrt9o {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:31 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:31 devstack sudo[102376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_98519bbd-c638-438b-821c-975d2da29f4f_98gwrt9o Nov 03 13:21:31 devstack sudo[102376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:31 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e8b0c17b-a07d-48f9-8c16-0b81ea2f1706 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e3c5ff8c-11f8-4b9a-97af-593172517a15" returned: 0 in 0.303s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:31 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e8b0c17b-a07d-48f9-8c16-0b81ea2f1706 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Lock "cinder-quobyte-e3c5ff8c-11f8-4b9a-97af-593172517a15" released by "delete_volume" :: held 0.777s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:32 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-e8b0c17b-a07d-48f9-8c16-0b81ea2f1706 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Created reservations ['dda5e423-69c3-4580-8ab7-64be20c2c172', '79ba156a-aeb3-4967-bd22-a36de40ef457', 'cb1c8de7-87e6-4b80-a61e-1fb7c94f61de', 'cd9b61ef-8cc8-4acf-b5d5-39d4b28efa98'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:21:32 devstack sudo[102376]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_98519bbd-c638-438b-821c-975d2da29f4f_98gwrt9o" returned: 0 in 0.367s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_98519bbd-c638-438b-821c-975d2da29f4f_98gwrt9o {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e8b0c17b-a07d-48f9-8c16-0b81ea2f1706 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e8b0c17b-a07d-48f9-8c16-0b81ea2f1706 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:32 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-e8b0c17b-a07d-48f9-8c16-0b81ea2f1706 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:32 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-e8b0c17b-a07d-48f9-8c16-0b81ea2f1706 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e8b0c17b-a07d-48f9-8c16-0b81ea2f1706 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e8b0c17b-a07d-48f9-8c16-0b81ea2f1706 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:32 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:21:32 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:32 devstack sudo[102381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_98519bbd-c638-438b-821c-975d2da29f4f_98gwrt9o Nov 03 13:21:32 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:32 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e8b0c17b-a07d-48f9-8c16-0b81ea2f1706 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.311s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:32 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-e8b0c17b-a07d-48f9-8c16-0b81ea2f1706 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:21:32 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-e8b0c17b-a07d-48f9-8c16-0b81ea2f1706 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Deleted volume successfully. Nov 03 13:21:32 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_98519bbd-c638-438b-821c-975d2da29f4f_98gwrt9o" returned: 1 in 0.438s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_98519bbd-c638-438b-821c-975d2da29f4f_98gwrt9o' failed. Not Retrying. {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:21:32 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[05344b10-21d6-4dcd-bea5-9901adb9d97f]: (4, 'raw') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:21:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_98519bbd-c638-438b-821c-975d2da29f4f_gv3y0o97devstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:32 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e8b0c17b-a07d-48f9-8c16-0b81ea2f1706 tempest-VolumesSnapshotNegativeTestJSON-1625343576 None] Lock "cinder-e3c5ff8c-11f8-4b9a-97af-593172517a15-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:32 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_98519bbd-c638-438b-821c-975d2da29f4f_gv3y0o97devstack@QuobyteHD Nov 03 13:21:32 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:32 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_98519bbd-c638-438b-821c-975d2da29f4f_gv3y0o97devstack@QuobyteHD" returned: 0 in 0.369s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98519bbd-c638-438b-821c-975d2da29f4f_gv3y0o97devstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:32 devstack sudo[102392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98519bbd-c638-438b-821c-975d2da29f4f_gv3y0o97devstack@QuobyteHD Nov 03 13:21:33 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:33 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98519bbd-c638-438b-821c-975d2da29f4f_gv3y0o97devstack@QuobyteHD" returned: 1 in 0.367s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98519bbd-c638-438b-821c-975d2da29f4f_gv3y0o97devstack@QuobyteHD' failed. Not Retrying. {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:21:33 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] 98519bbd-c638-438b-821c-975d2da29f4f was raw, converting to qcow2 {{(pid=86725) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 13:21:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_98519bbd-c638-438b-821c-975d2da29f4f_gv3y0o97devstack@QuobyteHD /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-07fa4328-07bf-4625-b617-b4544707e205 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:33 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_98519bbd-c638-438b-821c-975d2da29f4f_gv3y0o97devstack@QuobyteHD /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-07fa4328-07bf-4625-b617-b4544707e205 Nov 03 13:21:33 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:33 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_98519bbd-c638-438b-821c-975d2da29f4f_gv3y0o97devstack@QuobyteHD /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-07fa4328-07bf-4625-b617-b4544707e205" returned: 0 in 0.476s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:33 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_98519bbd-c638-438b-821c-975d2da29f4f_gv3y0o97devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-07fa4328-07bf-4625-b617-b4544707e205 {{(pid=86725) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:21:33 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 13:21:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-07fa4328-07bf-4625-b617-b4544707e205 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:33 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-07fa4328-07bf-4625-b617-b4544707e205 1G Nov 03 13:21:33 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:34 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-07fa4328-07bf-4625-b617-b4544707e205 1G" returned: 0 in 0.367s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:34 devstack cinder-volume[86725]: DEBUG cinder.volume.volume_utils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Downloaded image 98519bbd-c638-438b-821c-975d2da29f4f ((None, [{'url': 'file:///opt/stack/data/glance/images/98519bbd-c638-438b-821c-975d2da29f4f', 'metadata': {}}])) to volume 07fa4328-07bf-4625-b617-b4544707e205 successfully. {{(pid=86725) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 13:21:34 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Temporary image 98519bbd-c638-438b-821c-975d2da29f4f for user 6819ea1801d4474e83474db9536a1c84 is deleted. {{(pid=86725) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 13:21:34 devstack cinder-volume[86725]: DEBUG cinder.volume.volume_utils [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Marking volume 07fa4328-07bf-4625-b617-b4544707e205 as bootable. {{(pid=86725) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 13:21:34 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Copying metadata from image 98519bbd-c638-438b-821c-975d2da29f4f to 07fa4328-07bf-4625-b617-b4544707e205. {{(pid=86725) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 13:21:34 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Creating volume glance metadata for volume 07fa4328-07bf-4625-b617-b4544707e205 backed by image 98519bbd-c638-438b-821c-975d2da29f4f with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '98519bbd-c638-438b-821c-975d2da29f4f', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'edc0010eaa0c9489ea47bcd4e0f31c86', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86725) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 13:21:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a8508a7-ff2f-45e6-abe5-54dbb439f8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07fa4328-07bf-4625-b617-b4544707e205', 'volume_size': 1, 'image_id': '98519bbd-c638-438b-821c-975d2da29f4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/98519bbd-c638-438b-821c-975d2da29f4f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'edc0010eaa0c9489ea47bcd4e0f31c86', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ae6fda07540249adb00a882967b11966', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0d6e93e3215499905384ba5e2e38fc3c3946d16be6fcf35bb03690b00a25b1faf855147b8a744fe8a53c4dd220c4e79025a043403ce26ad7ffc98fd608178088', 'id': '98519bbd-c638-438b-821c-975d2da29f4f', 'created_at': datetime.datetime(2026, 11, 3, 12, 21, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 21, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98519bbd-c638-438b-821c-975d2da29f4f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a74a5d4-0575-4684-bccb-c2a5573768fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:34 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Volume volume-07fa4328-07bf-4625-b617-b4544707e205 (07fa4328-07bf-4625-b617-b4544707e205): created successfully Nov 03 13:21:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a74a5d4-0575-4684-bccb-c2a5573768fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:34 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Flow 'volume_create_manager' (3cc2ade2-251a-42f2-909d-f78ca7b16eb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:21:34 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-5c59f8e7-435c-472a-b577-e13779a27df1 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Created volume successfully. Nov 03 13:21:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-38c1433d-7def-4872-a7b5-6bdcc9f8bf75 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Acquiring lock "cinder-07fa4328-07bf-4625-b617-b4544707e205-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-38c1433d-7def-4872-a7b5-6bdcc9f8bf75 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Lock "cinder-07fa4328-07bf-4625-b617-b4544707e205-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-38c1433d-7def-4872-a7b5-6bdcc9f8bf75 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Acquiring lock "cinder-quobyte-07fa4328-07bf-4625-b617-b4544707e205" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-38c1433d-7def-4872-a7b5-6bdcc9f8bf75 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Lock "cinder-quobyte-07fa4328-07bf-4625-b617-b4544707e205" acquired by "delete_volume" :: waited 0.016s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:35 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fe5fd6-eb40-4b0f-9ec0-cffeb5ba3df4]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:21:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-38c1433d-7def-4872-a7b5-6bdcc9f8bf75 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-07fa4328-07bf-4625-b617-b4544707e205 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:35 devstack sudo[102409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-07fa4328-07bf-4625-b617-b4544707e205 Nov 03 13:21:35 devstack sudo[102409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:35 devstack sudo[102409]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-38c1433d-7def-4872-a7b5-6bdcc9f8bf75 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-07fa4328-07bf-4625-b617-b4544707e205" returned: 0 in 0.386s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-38c1433d-7def-4872-a7b5-6bdcc9f8bf75 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-07fa4328-07bf-4625-b617-b4544707e205 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:35 devstack sudo[102414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-07fa4328-07bf-4625-b617-b4544707e205 Nov 03 13:21:35 devstack sudo[102414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:35 devstack sudo[102414]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-38c1433d-7def-4872-a7b5-6bdcc9f8bf75 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-07fa4328-07bf-4625-b617-b4544707e205" returned: 0 in 0.263s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-38c1433d-7def-4872-a7b5-6bdcc9f8bf75 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Lock "cinder-quobyte-07fa4328-07bf-4625-b617-b4544707e205" released by "delete_volume" :: held 0.697s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:35 devstack cinder-volume[86725]: WARNING cinder.quota [None req-38c1433d-7def-4872-a7b5-6bdcc9f8bf75 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:21:35 devstack cinder-volume[86725]: WARNING cinder.quota [None req-38c1433d-7def-4872-a7b5-6bdcc9f8bf75 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:21:35 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-38c1433d-7def-4872-a7b5-6bdcc9f8bf75 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Created reservations ['37e12806-0e34-4829-a9b6-6d264d222ef6', '3574ffa2-fa67-4fb9-8a57-adffddd995ef', 'bdb7b61e-d13a-4abf-ad7e-4088048e1a2d', '203f5196-0074-4004-abc0-32047493d3ff'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:21:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-38c1433d-7def-4872-a7b5-6bdcc9f8bf75 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-38c1433d-7def-4872-a7b5-6bdcc9f8bf75 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:35 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-38c1433d-7def-4872-a7b5-6bdcc9f8bf75 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:35 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-38c1433d-7def-4872-a7b5-6bdcc9f8bf75 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-38c1433d-7def-4872-a7b5-6bdcc9f8bf75 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-38c1433d-7def-4872-a7b5-6bdcc9f8bf75 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:36 devstack sudo[102418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:21:36 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:36 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-38c1433d-7def-4872-a7b5-6bdcc9f8bf75 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.328s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:36 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-38c1433d-7def-4872-a7b5-6bdcc9f8bf75 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:21:36 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-38c1433d-7def-4872-a7b5-6bdcc9f8bf75 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Deleted volume successfully. Nov 03 13:21:36 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-38c1433d-7def-4872-a7b5-6bdcc9f8bf75 tempest-VolumeAndVolumeTypeFromImageTest-741865197 None] Lock "cinder-07fa4328-07bf-4625-b617-b4544707e205-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] Flow 'volume_create_manager' (6aa42a06-b626-4433-8a70-7e31c8f5b22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e97a0132-24b9-49db-b204-920f754e2d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e97a0132-24b9-49db-b204-920f754e2d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-324792468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d7f50ae-aaee-4691-a4f4-2f757f32de7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8675407574e44c47bf63130efa02b03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:21:41Z,use_quota=True,user_id='e43a4fe03902402ebea9e6469fb954f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6244dfbd-1831-48b9-91f1-515cc856932d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6244dfbd-1831-48b9-91f1-515cc856932d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a6a5adb-a84b-4206-9cd0-8b602311af8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a6a5adb-a84b-4206-9cd0-8b602311af8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d7f50ae-aaee-4691-a4f4-2f757f32de7a', 'volume_name': 'volume-2d7f50ae-aaee-4691-a4f4-2f757f32de7a', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c36b111-0fcb-4603-afb3-ad9b007449b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c36b111-0fcb-4603-afb3-ad9b007449b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a2d77ae-a4e6-4822-97f7-789b55971e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:41 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] Volume 2d7f50ae-aaee-4691-a4f4-2f757f32de7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d7f50ae-aaee-4691-a4f4-2f757f32de7a', 'volume_size': 1} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-324792468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d7f50ae-aaee-4691-a4f4-2f757f32de7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8675407574e44c47bf63130efa02b03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:21:41Z,use_quota=True,user_id='e43a4fe03902402ebea9e6469fb954f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] Creating volume 2d7f50ae-aaee-4691-a4f4-2f757f32de7a {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:21:41 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2d7f50ae-aaee-4691-a4f4-2f757f32de7a 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:41 devstack sudo[102421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2d7f50ae-aaee-4691-a4f4-2f757f32de7a 1073741824 Nov 03 13:21:41 devstack sudo[102421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] Flow 'volume_create_manager' (28939378-fa42-4756-bed3-2ce08c0b9950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da3b4fb2-64f6-427f-9fdc-a9d14bdfc8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da3b4fb2-64f6-427f-9fdc-a9d14bdfc8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1694439437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2b91c0a-deac-4cd9-970a-d0c5a5de7779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8675407574e44c47bf63130efa02b03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:21:41Z,use_quota=True,user_id='e43a4fe03902402ebea9e6469fb954f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (781ea665-76de-4442-80e3-bf208bd65ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (781ea665-76de-4442-80e3-bf208bd65ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8f72e55-a8ba-4013-a514-6b0056b4311e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8f72e55-a8ba-4013-a514-6b0056b4311e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2b91c0a-deac-4cd9-970a-d0c5a5de7779', 'volume_name': 'volume-c2b91c0a-deac-4cd9-970a-d0c5a5de7779', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45d6f99-36e7-446f-a496-2c78498f4d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45d6f99-36e7-446f-a496-2c78498f4d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (158f51ba-240c-4161-b7fa-392a2aad7926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:41 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] Volume c2b91c0a-deac-4cd9-970a-d0c5a5de7779: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2b91c0a-deac-4cd9-970a-d0c5a5de7779', 'volume_size': 1} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] Flow 'volume_create_manager' (69403366-c81f-46d5-874c-0089c6f825ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad954098-bcfc-47f1-974e-747be8745df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad954098-bcfc-47f1-974e-747be8745df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-940266529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53261344-725f-4e08-8918-25845b7e9450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8675407574e44c47bf63130efa02b03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:21:42Z,use_quota=True,user_id='e43a4fe03902402ebea9e6469fb954f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6836566-4715-41cb-8f94-091b9411efeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6836566-4715-41cb-8f94-091b9411efeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2f79877-550b-4818-9690-a36b67a74936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2f79877-550b-4818-9690-a36b67a74936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53261344-725f-4e08-8918-25845b7e9450', 'volume_name': 'volume-53261344-725f-4e08-8918-25845b7e9450', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a142f1-3ce9-4c56-90d7-22a2c959efeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a142f1-3ce9-4c56-90d7-22a2c959efeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2fdf8f9-6d57-4ad4-827b-84cb5754f9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:41 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] Volume 53261344-725f-4e08-8918-25845b7e9450: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53261344-725f-4e08-8918-25845b7e9450', 'volume_size': 1} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:41 devstack sudo[102421]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2d7f50ae-aaee-4691-a4f4-2f757f32de7a 1073741824" returned: 0 in 0.659s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2d7f50ae-aaee-4691-a4f4-2f757f32de7a {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:41 devstack sudo[102427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2d7f50ae-aaee-4691-a4f4-2f757f32de7a Nov 03 13:21:41 devstack sudo[102427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] Flow 'volume_create_manager' (72518a20-0a5e-4745-a047-c1242336d225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceff3b5a-f26b-46e7-ad0b-d4663d092001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceff3b5a-f26b-46e7-ad0b-d4663d092001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-302928450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=277d2d8a-ac4c-4866-9bc2-ac4c6feeb866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8675407574e44c47bf63130efa02b03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:21:42Z,use_quota=True,user_id='e43a4fe03902402ebea9e6469fb954f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22fa98a8-b995-4c03-9a5c-e2622b351fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22fa98a8-b995-4c03-9a5c-e2622b351fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad8a5627-e63b-4997-864a-f5fdcb67f664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad8a5627-e63b-4997-864a-f5fdcb67f664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '277d2d8a-ac4c-4866-9bc2-ac4c6feeb866', 'volume_name': 'volume-277d2d8a-ac4c-4866-9bc2-ac4c6feeb866', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a31e051-a922-49b6-a250-11f76b35f458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a31e051-a922-49b6-a250-11f76b35f458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75b40512-d815-4676-b19d-226e27d0538c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:42 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] Volume 277d2d8a-ac4c-4866-9bc2-ac4c6feeb866: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-277d2d8a-ac4c-4866-9bc2-ac4c6feeb866', 'volume_size': 1} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:42 devstack sudo[102427]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2d7f50ae-aaee-4691-a4f4-2f757f32de7a" returned: 0 in 0.390s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.901s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1694439437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2b91c0a-deac-4cd9-970a-d0c5a5de7779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8675407574e44c47bf63130efa02b03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:21:41Z,use_quota=True,user_id='e43a4fe03902402ebea9e6469fb954f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] Creating volume c2b91c0a-deac-4cd9-970a-d0c5a5de7779 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:21:42 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c2b91c0a-deac-4cd9-970a-d0c5a5de7779 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a2d77ae-a4e6-4822-97f7-789b55971e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d7f50ae-aaee-4691-a4f4-2f757f32de7a', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:42 devstack sudo[102430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c2b91c0a-deac-4cd9-970a-d0c5a5de7779 1073741824 Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac3d6a1-abf2-4d74-b507-b6d9b76b8507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:42 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:42 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] Volume volume-2d7f50ae-aaee-4691-a4f4-2f757f32de7a (2d7f50ae-aaee-4691-a4f4-2f757f32de7a): created successfully Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac3d6a1-abf2-4d74-b507-b6d9b76b8507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] Flow 'volume_create_manager' (6aa42a06-b626-4433-8a70-7e31c8f5b22b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:21:42 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-443bcba7-7669-459e-8633-f191018b1d30 tempest-CreateVolumesFromImageTest-1148490772 None] Created volume successfully. Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] Flow 'volume_create_manager' (4e01b04d-bb95-4ef3-b5b2-8743a25fd0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bed8238-7b83-4a5e-a23c-5b35c6096f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bed8238-7b83-4a5e-a23c-5b35c6096f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1084460357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=326b68c5-6073-4f1d-acce-e688c1280ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8675407574e44c47bf63130efa02b03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:21:43Z,use_quota=True,user_id='e43a4fe03902402ebea9e6469fb954f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57398810-9b4a-4297-bf0d-f7ccc7fbacd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57398810-9b4a-4297-bf0d-f7ccc7fbacd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf1f5a3-027f-4a6d-beb0-f7d7f3056fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf1f5a3-027f-4a6d-beb0-f7d7f3056fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '326b68c5-6073-4f1d-acce-e688c1280ab7', 'volume_name': 'volume-326b68c5-6073-4f1d-acce-e688c1280ab7', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b04f47da-1835-4218-aeb1-add95f44debc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b04f47da-1835-4218-aeb1-add95f44debc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0997f596-0a0f-4c9c-abc0-6dc8bff5cd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:42 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] Volume 326b68c5-6073-4f1d-acce-e688c1280ab7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-326b68c5-6073-4f1d-acce-e688c1280ab7', 'volume_size': 1} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:42 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c2b91c0a-deac-4cd9-970a-d0c5a5de7779 1073741824" returned: 0 in 0.577s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c2b91c0a-deac-4cd9-970a-d0c5a5de7779 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:42 devstack sudo[102435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c2b91c0a-deac-4cd9-970a-d0c5a5de7779 Nov 03 13:21:42 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:43 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c2b91c0a-deac-4cd9-970a-d0c5a5de7779" returned: 0 in 0.256s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:43 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:21:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.377s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:43 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-940266529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53261344-725f-4e08-8918-25845b7e9450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8675407574e44c47bf63130efa02b03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:21:42Z,use_quota=True,user_id='e43a4fe03902402ebea9e6469fb954f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:21:43 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] Creating volume 53261344-725f-4e08-8918-25845b7e9450 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:21:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:43 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:43 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:43 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:21:43 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:21:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-53261344-725f-4e08-8918-25845b7e9450 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (158f51ba-240c-4161-b7fa-392a2aad7926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2b91c0a-deac-4cd9-970a-d0c5a5de7779', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a50ba42-ffea-48f5-8327-00fe7d842bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:43 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-53261344-725f-4e08-8918-25845b7e9450 1073741824 Nov 03 13:21:43 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:43 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] Volume volume-c2b91c0a-deac-4cd9-970a-d0c5a5de7779 (c2b91c0a-deac-4cd9-970a-d0c5a5de7779): created successfully Nov 03 13:21:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a50ba42-ffea-48f5-8327-00fe7d842bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] Flow 'volume_create_manager' (28939378-fa42-4756-bed3-2ce08c0b9950) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:21:43 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-c557f593-059d-4ec5-adf4-ee304655bd76 tempest-CreateVolumesFromImageTest-1148490772 None] Created volume successfully. Nov 03 13:21:43 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-53261344-725f-4e08-8918-25845b7e9450 1073741824" returned: 0 in 0.530s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-53261344-725f-4e08-8918-25845b7e9450 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:43 devstack sudo[102444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-53261344-725f-4e08-8918-25845b7e9450 Nov 03 13:21:43 devstack sudo[102444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:43 devstack sudo[102444]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-53261344-725f-4e08-8918-25845b7e9450" returned: 0 in 0.251s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.749s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-302928450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=277d2d8a-ac4c-4866-9bc2-ac4c6feeb866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8675407574e44c47bf63130efa02b03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:21:42Z,use_quota=True,user_id='e43a4fe03902402ebea9e6469fb954f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] Creating volume 277d2d8a-ac4c-4866-9bc2-ac4c6feeb866 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:21:44 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-277d2d8a-ac4c-4866-9bc2-ac4c6feeb866 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2fdf8f9-6d57-4ad4-827b-84cb5754f9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53261344-725f-4e08-8918-25845b7e9450', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:44 devstack sudo[102447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-277d2d8a-ac4c-4866-9bc2-ac4c6feeb866 1073741824 Nov 03 13:21:44 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2734688-e2f3-4c79-85dd-f23acaacead2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:44 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] Volume volume-53261344-725f-4e08-8918-25845b7e9450 (53261344-725f-4e08-8918-25845b7e9450): created successfully Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2734688-e2f3-4c79-85dd-f23acaacead2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] Flow 'volume_create_manager' (69403366-c81f-46d5-874c-0089c6f825ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:21:44 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-d97e73c6-40d3-42a5-a5c5-a785d975ebff tempest-CreateVolumesFromImageTest-1148490772 None] Created volume successfully. Nov 03 13:21:44 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-277d2d8a-ac4c-4866-9bc2-ac4c6feeb866 1073741824" returned: 0 in 0.496s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-277d2d8a-ac4c-4866-9bc2-ac4c6feeb866 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:44 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-277d2d8a-ac4c-4866-9bc2-ac4c6feeb866 Nov 03 13:21:44 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:44 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-277d2d8a-ac4c-4866-9bc2-ac4c6feeb866" returned: 0 in 0.260s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.122s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1084460357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=326b68c5-6073-4f1d-acce-e688c1280ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8675407574e44c47bf63130efa02b03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:21:43Z,use_quota=True,user_id='e43a4fe03902402ebea9e6469fb954f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] Creating volume 326b68c5-6073-4f1d-acce-e688c1280ab7 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:21:44 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-326b68c5-6073-4f1d-acce-e688c1280ab7 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75b40512-d815-4676-b19d-226e27d0538c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-277d2d8a-ac4c-4866-9bc2-ac4c6feeb866', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b2962e-2b3a-48a9-a0e8-31b62bc5c88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:44 devstack sudo[102456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-326b68c5-6073-4f1d-acce-e688c1280ab7 1073741824 Nov 03 13:21:44 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:44 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] Volume volume-277d2d8a-ac4c-4866-9bc2-ac4c6feeb866 (277d2d8a-ac4c-4866-9bc2-ac4c6feeb866): created successfully Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b2962e-2b3a-48a9-a0e8-31b62bc5c88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] Flow 'volume_create_manager' (72518a20-0a5e-4745-a047-c1242336d225) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:21:44 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-2dacf722-64f1-4632-8d92-c1ad0a5818aa tempest-CreateVolumesFromImageTest-1148490772 None] Created volume successfully. Nov 03 13:21:45 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-326b68c5-6073-4f1d-acce-e688c1280ab7 1073741824" returned: 0 in 0.483s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-326b68c5-6073-4f1d-acce-e688c1280ab7 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:45 devstack sudo[102463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-326b68c5-6073-4f1d-acce-e688c1280ab7 Nov 03 13:21:45 devstack sudo[102463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:45 devstack sudo[102463]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-326b68c5-6073-4f1d-acce-e688c1280ab7" returned: 0 in 0.253s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:45 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:21:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0997f596-0a0f-4c9c-abc0-6dc8bff5cd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-326b68c5-6073-4f1d-acce-e688c1280ab7', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6579988d-b32e-4aaf-8783-069646ad52c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:45 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] Volume volume-326b68c5-6073-4f1d-acce-e688c1280ab7 (326b68c5-6073-4f1d-acce-e688c1280ab7): created successfully Nov 03 13:21:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6579988d-b32e-4aaf-8783-069646ad52c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] Flow 'volume_create_manager' (4e01b04d-bb95-4ef3-b5b2-8743a25fd0a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:21:45 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-615a320a-21fc-49db-b382-1ab9844ec9e5 tempest-CreateVolumesFromImageTest-1148490772 None] Created volume successfully. Nov 03 13:21:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-395b3de3-28eb-42e4-a6f4-f2d74900c871 tempest-CreateVolumesFromImageTest-1148490772 None] Acquiring lock "cinder-326b68c5-6073-4f1d-acce-e688c1280ab7-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-395b3de3-28eb-42e4-a6f4-f2d74900c871 tempest-CreateVolumesFromImageTest-1148490772 None] Lock "cinder-326b68c5-6073-4f1d-acce-e688c1280ab7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-395b3de3-28eb-42e4-a6f4-f2d74900c871 tempest-CreateVolumesFromImageTest-1148490772 None] Acquiring lock "cinder-quobyte-326b68c5-6073-4f1d-acce-e688c1280ab7" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-395b3de3-28eb-42e4-a6f4-f2d74900c871 tempest-CreateVolumesFromImageTest-1148490772 None] Lock "cinder-quobyte-326b68c5-6073-4f1d-acce-e688c1280ab7" acquired by "delete_volume" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:46 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb87241b-a875-4296-ae85-51500c367de4]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:21:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-395b3de3-28eb-42e4-a6f4-f2d74900c871 tempest-CreateVolumesFromImageTest-1148490772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-326b68c5-6073-4f1d-acce-e688c1280ab7 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:46 devstack sudo[102467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-326b68c5-6073-4f1d-acce-e688c1280ab7 Nov 03 13:21:46 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:46 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-395b3de3-28eb-42e4-a6f4-f2d74900c871 tempest-CreateVolumesFromImageTest-1148490772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-326b68c5-6073-4f1d-acce-e688c1280ab7" returned: 0 in 0.451s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-395b3de3-28eb-42e4-a6f4-f2d74900c871 tempest-CreateVolumesFromImageTest-1148490772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-326b68c5-6073-4f1d-acce-e688c1280ab7 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:46 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-326b68c5-6073-4f1d-acce-e688c1280ab7 Nov 03 13:21:46 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:46 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-395b3de3-28eb-42e4-a6f4-f2d74900c871 tempest-CreateVolumesFromImageTest-1148490772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-326b68c5-6073-4f1d-acce-e688c1280ab7" returned: 0 in 0.289s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-395b3de3-28eb-42e4-a6f4-f2d74900c871 tempest-CreateVolumesFromImageTest-1148490772 None] Lock "cinder-quobyte-326b68c5-6073-4f1d-acce-e688c1280ab7" released by "delete_volume" :: held 0.791s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:46 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-395b3de3-28eb-42e4-a6f4-f2d74900c871 tempest-CreateVolumesFromImageTest-1148490772 None] Created reservations ['e91b2ba7-b4b4-438e-8dbf-9c8e6cf50f8e', '82bf72b6-382b-437b-89f6-b265342e5c08', '5cd0d17b-d921-4b4e-a1f1-5ca9522cbb32', 'a4b360e4-4781-4cbc-97bf-d96e0f339e6d'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:21:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-395b3de3-28eb-42e4-a6f4-f2d74900c871 tempest-CreateVolumesFromImageTest-1148490772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-395b3de3-28eb-42e4-a6f4-f2d74900c871 tempest-CreateVolumesFromImageTest-1148490772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:47 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-395b3de3-28eb-42e4-a6f4-f2d74900c871 tempest-CreateVolumesFromImageTest-1148490772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:47 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-395b3de3-28eb-42e4-a6f4-f2d74900c871 tempest-CreateVolumesFromImageTest-1148490772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-395b3de3-28eb-42e4-a6f4-f2d74900c871 tempest-CreateVolumesFromImageTest-1148490772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-395b3de3-28eb-42e4-a6f4-f2d74900c871 tempest-CreateVolumesFromImageTest-1148490772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:47 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:21:47 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:47 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-305cdbbc-f0cb-43b2-a625-5c23878c3c0b tempest-CreateVolumesFromImageTest-1148490772 None] Acquiring lock "cinder-277d2d8a-ac4c-4866-9bc2-ac4c6feeb866-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:47 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-305cdbbc-f0cb-43b2-a625-5c23878c3c0b tempest-CreateVolumesFromImageTest-1148490772 None] Lock "cinder-277d2d8a-ac4c-4866-9bc2-ac4c6feeb866-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:47 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-395b3de3-28eb-42e4-a6f4-f2d74900c871 tempest-CreateVolumesFromImageTest-1148490772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.289s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:47 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-395b3de3-28eb-42e4-a6f4-f2d74900c871 tempest-CreateVolumesFromImageTest-1148490772 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:21:47 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-305cdbbc-f0cb-43b2-a625-5c23878c3c0b tempest-CreateVolumesFromImageTest-1148490772 None] Acquiring lock "cinder-quobyte-277d2d8a-ac4c-4866-9bc2-ac4c6feeb866" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:47 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-395b3de3-28eb-42e4-a6f4-f2d74900c871 tempest-CreateVolumesFromImageTest-1148490772 None] Deleted volume successfully. Nov 03 13:21:47 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-305cdbbc-f0cb-43b2-a625-5c23878c3c0b tempest-CreateVolumesFromImageTest-1148490772 None] Lock "cinder-quobyte-277d2d8a-ac4c-4866-9bc2-ac4c6feeb866" acquired by "delete_volume" :: waited 0.024s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:47 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-395b3de3-28eb-42e4-a6f4-f2d74900c871 tempest-CreateVolumesFromImageTest-1148490772 None] Lock "cinder-326b68c5-6073-4f1d-acce-e688c1280ab7-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:47 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b0396f-a7eb-40c4-a28c-c8968474b720]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:21:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-305cdbbc-f0cb-43b2-a625-5c23878c3c0b tempest-CreateVolumesFromImageTest-1148490772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-277d2d8a-ac4c-4866-9bc2-ac4c6feeb866 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:47 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-277d2d8a-ac4c-4866-9bc2-ac4c6feeb866 Nov 03 13:21:47 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:47 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-305cdbbc-f0cb-43b2-a625-5c23878c3c0b tempest-CreateVolumesFromImageTest-1148490772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-277d2d8a-ac4c-4866-9bc2-ac4c6feeb866" returned: 0 in 0.388s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-305cdbbc-f0cb-43b2-a625-5c23878c3c0b tempest-CreateVolumesFromImageTest-1148490772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-277d2d8a-ac4c-4866-9bc2-ac4c6feeb866 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:47 devstack sudo[102483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-277d2d8a-ac4c-4866-9bc2-ac4c6feeb866 Nov 03 13:21:47 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:48 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-305cdbbc-f0cb-43b2-a625-5c23878c3c0b tempest-CreateVolumesFromImageTest-1148490772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-277d2d8a-ac4c-4866-9bc2-ac4c6feeb866" returned: 0 in 0.279s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:48 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-305cdbbc-f0cb-43b2-a625-5c23878c3c0b tempest-CreateVolumesFromImageTest-1148490772 None] Lock "cinder-quobyte-277d2d8a-ac4c-4866-9bc2-ac4c6feeb866" released by "delete_volume" :: held 0.720s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:48 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-305cdbbc-f0cb-43b2-a625-5c23878c3c0b tempest-CreateVolumesFromImageTest-1148490772 None] Created reservations ['d93a5017-6a3d-47f5-9cfe-ea8359e9da3a', '69044095-0ee7-493a-a819-e45a8ccc6ec5', '9d9a4ca6-badb-44ca-aaa7-4ed2c2d01ad3', 'f747d682-60c1-4d1a-b909-0468a8dc1f07'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:21:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-305cdbbc-f0cb-43b2-a625-5c23878c3c0b tempest-CreateVolumesFromImageTest-1148490772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-305cdbbc-f0cb-43b2-a625-5c23878c3c0b tempest-CreateVolumesFromImageTest-1148490772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:48 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-305cdbbc-f0cb-43b2-a625-5c23878c3c0b tempest-CreateVolumesFromImageTest-1148490772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:48 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-305cdbbc-f0cb-43b2-a625-5c23878c3c0b tempest-CreateVolumesFromImageTest-1148490772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-305cdbbc-f0cb-43b2-a625-5c23878c3c0b tempest-CreateVolumesFromImageTest-1148490772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-305cdbbc-f0cb-43b2-a625-5c23878c3c0b tempest-CreateVolumesFromImageTest-1148490772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:48 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:21:48 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:48 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-f5bc62e1-2da9-43bf-b754-907c65fa54cb tempest-CreateVolumesFromImageTest-1148490772 None] Acquiring lock "cinder-53261344-725f-4e08-8918-25845b7e9450-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:48 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-305cdbbc-f0cb-43b2-a625-5c23878c3c0b tempest-CreateVolumesFromImageTest-1148490772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.275s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:48 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-305cdbbc-f0cb-43b2-a625-5c23878c3c0b tempest-CreateVolumesFromImageTest-1148490772 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:21:48 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-f5bc62e1-2da9-43bf-b754-907c65fa54cb tempest-CreateVolumesFromImageTest-1148490772 None] Lock "cinder-53261344-725f-4e08-8918-25845b7e9450-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:48 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-305cdbbc-f0cb-43b2-a625-5c23878c3c0b tempest-CreateVolumesFromImageTest-1148490772 None] Deleted volume successfully. Nov 03 13:21:48 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-305cdbbc-f0cb-43b2-a625-5c23878c3c0b tempest-CreateVolumesFromImageTest-1148490772 None] Lock "cinder-277d2d8a-ac4c-4866-9bc2-ac4c6feeb866-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:48 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-f5bc62e1-2da9-43bf-b754-907c65fa54cb tempest-CreateVolumesFromImageTest-1148490772 None] Acquiring lock "cinder-quobyte-53261344-725f-4e08-8918-25845b7e9450" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:48 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-f5bc62e1-2da9-43bf-b754-907c65fa54cb tempest-CreateVolumesFromImageTest-1148490772 None] Lock "cinder-quobyte-53261344-725f-4e08-8918-25845b7e9450" acquired by "delete_volume" :: waited 0.021s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:48 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b57d68-88bd-4546-8def-cab88d2a21e7]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:21:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f5bc62e1-2da9-43bf-b754-907c65fa54cb tempest-CreateVolumesFromImageTest-1148490772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-53261344-725f-4e08-8918-25845b7e9450 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:48 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-53261344-725f-4e08-8918-25845b7e9450 Nov 03 13:21:48 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:48 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f5bc62e1-2da9-43bf-b754-907c65fa54cb tempest-CreateVolumesFromImageTest-1148490772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-53261344-725f-4e08-8918-25845b7e9450" returned: 0 in 0.390s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f5bc62e1-2da9-43bf-b754-907c65fa54cb tempest-CreateVolumesFromImageTest-1148490772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-53261344-725f-4e08-8918-25845b7e9450 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:49 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-53261344-725f-4e08-8918-25845b7e9450 Nov 03 13:21:49 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:49 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f5bc62e1-2da9-43bf-b754-907c65fa54cb tempest-CreateVolumesFromImageTest-1148490772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-53261344-725f-4e08-8918-25845b7e9450" returned: 0 in 0.300s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:49 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-f5bc62e1-2da9-43bf-b754-907c65fa54cb tempest-CreateVolumesFromImageTest-1148490772 None] Lock "cinder-quobyte-53261344-725f-4e08-8918-25845b7e9450" released by "delete_volume" :: held 0.744s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:49 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-f5bc62e1-2da9-43bf-b754-907c65fa54cb tempest-CreateVolumesFromImageTest-1148490772 None] Created reservations ['46a30aa4-4e36-4b20-9c89-5b24b450c5d8', '193f6ad7-3bc5-4078-9c43-8e9ed7b5577f', '12e1f0a3-ff2d-45b7-a837-1708b0396175', '9eb79133-95ce-475b-b0d7-29f591b6b1d6'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:21:49 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=173,cinder:INSERT=66,cinder:UPDATE=211,cinder:DELETE=17 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:21:49 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=161,cinder:UPDATE=234,cinder:INSERT=60,cinder:DELETE=20 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:21:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f5bc62e1-2da9-43bf-b754-907c65fa54cb tempest-CreateVolumesFromImageTest-1148490772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f5bc62e1-2da9-43bf-b754-907c65fa54cb tempest-CreateVolumesFromImageTest-1148490772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f5bc62e1-2da9-43bf-b754-907c65fa54cb tempest-CreateVolumesFromImageTest-1148490772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f5bc62e1-2da9-43bf-b754-907c65fa54cb tempest-CreateVolumesFromImageTest-1148490772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f5bc62e1-2da9-43bf-b754-907c65fa54cb tempest-CreateVolumesFromImageTest-1148490772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f5bc62e1-2da9-43bf-b754-907c65fa54cb tempest-CreateVolumesFromImageTest-1148490772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:49 devstack sudo[102533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:21:49 devstack sudo[102533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:49 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b7c80d5a-62dd-4c83-999d-a144635bb040 tempest-CreateVolumesFromImageTest-1148490772 None] Acquiring lock "cinder-c2b91c0a-deac-4cd9-970a-d0c5a5de7779-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:49 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b7c80d5a-62dd-4c83-999d-a144635bb040 tempest-CreateVolumesFromImageTest-1148490772 None] Lock "cinder-c2b91c0a-deac-4cd9-970a-d0c5a5de7779-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:49 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b7c80d5a-62dd-4c83-999d-a144635bb040 tempest-CreateVolumesFromImageTest-1148490772 None] Acquiring lock "cinder-quobyte-c2b91c0a-deac-4cd9-970a-d0c5a5de7779" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:49 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b7c80d5a-62dd-4c83-999d-a144635bb040 tempest-CreateVolumesFromImageTest-1148490772 None] Lock "cinder-quobyte-c2b91c0a-deac-4cd9-970a-d0c5a5de7779" acquired by "delete_volume" :: waited 0.022s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:49 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e85fc0-727f-4e87-9e1f-3fb7a1279387]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:21:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b7c80d5a-62dd-4c83-999d-a144635bb040 tempest-CreateVolumesFromImageTest-1148490772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c2b91c0a-deac-4cd9-970a-d0c5a5de7779 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:49 devstack sudo[102533]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f5bc62e1-2da9-43bf-b754-907c65fa54cb tempest-CreateVolumesFromImageTest-1148490772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.300s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:49 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-f5bc62e1-2da9-43bf-b754-907c65fa54cb tempest-CreateVolumesFromImageTest-1148490772 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:21:49 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-f5bc62e1-2da9-43bf-b754-907c65fa54cb tempest-CreateVolumesFromImageTest-1148490772 None] Deleted volume successfully. Nov 03 13:21:49 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-f5bc62e1-2da9-43bf-b754-907c65fa54cb tempest-CreateVolumesFromImageTest-1148490772 None] Lock "cinder-53261344-725f-4e08-8918-25845b7e9450-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:49 devstack sudo[102536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c2b91c0a-deac-4cd9-970a-d0c5a5de7779 Nov 03 13:21:49 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:50 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b7c80d5a-62dd-4c83-999d-a144635bb040 tempest-CreateVolumesFromImageTest-1148490772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c2b91c0a-deac-4cd9-970a-d0c5a5de7779" returned: 0 in 0.421s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b7c80d5a-62dd-4c83-999d-a144635bb040 tempest-CreateVolumesFromImageTest-1148490772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c2b91c0a-deac-4cd9-970a-d0c5a5de7779 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:50 devstack sudo[102541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c2b91c0a-deac-4cd9-970a-d0c5a5de7779 Nov 03 13:21:50 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:50 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b7c80d5a-62dd-4c83-999d-a144635bb040 tempest-CreateVolumesFromImageTest-1148490772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c2b91c0a-deac-4cd9-970a-d0c5a5de7779" returned: 0 in 0.256s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b7c80d5a-62dd-4c83-999d-a144635bb040 tempest-CreateVolumesFromImageTest-1148490772 None] Lock "cinder-quobyte-c2b91c0a-deac-4cd9-970a-d0c5a5de7779" released by "delete_volume" :: held 0.725s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:50 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-b7c80d5a-62dd-4c83-999d-a144635bb040 tempest-CreateVolumesFromImageTest-1148490772 None] Created reservations ['05e8cd7d-09a2-4431-8bb1-1afbd9461569', '1393cb3b-5a6d-4273-a6cb-636cc51ca8cd', 'd557c825-540e-441a-b029-4a57a76a1c02', '29788ade-9032-4f6a-a0de-74e00c6db234'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:21:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b7c80d5a-62dd-4c83-999d-a144635bb040 tempest-CreateVolumesFromImageTest-1148490772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b7c80d5a-62dd-4c83-999d-a144635bb040 tempest-CreateVolumesFromImageTest-1148490772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b7c80d5a-62dd-4c83-999d-a144635bb040 tempest-CreateVolumesFromImageTest-1148490772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b7c80d5a-62dd-4c83-999d-a144635bb040 tempest-CreateVolumesFromImageTest-1148490772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b7c80d5a-62dd-4c83-999d-a144635bb040 tempest-CreateVolumesFromImageTest-1148490772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b7c80d5a-62dd-4c83-999d-a144635bb040 tempest-CreateVolumesFromImageTest-1148490772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:50 devstack sudo[102544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:21:50 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:50 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-226b4071-b053-4aaa-a5e5-eb5e01b0599b tempest-CreateVolumesFromImageTest-1148490772 None] Acquiring lock "cinder-2d7f50ae-aaee-4691-a4f4-2f757f32de7a-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b7c80d5a-62dd-4c83-999d-a144635bb040 tempest-CreateVolumesFromImageTest-1148490772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.253s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:50 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-b7c80d5a-62dd-4c83-999d-a144635bb040 tempest-CreateVolumesFromImageTest-1148490772 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:21:50 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-b7c80d5a-62dd-4c83-999d-a144635bb040 tempest-CreateVolumesFromImageTest-1148490772 None] Deleted volume successfully. Nov 03 13:21:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-226b4071-b053-4aaa-a5e5-eb5e01b0599b tempest-CreateVolumesFromImageTest-1148490772 None] Lock "cinder-2d7f50ae-aaee-4691-a4f4-2f757f32de7a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b7c80d5a-62dd-4c83-999d-a144635bb040 tempest-CreateVolumesFromImageTest-1148490772 None] Lock "cinder-c2b91c0a-deac-4cd9-970a-d0c5a5de7779-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-226b4071-b053-4aaa-a5e5-eb5e01b0599b tempest-CreateVolumesFromImageTest-1148490772 None] Acquiring lock "cinder-quobyte-2d7f50ae-aaee-4691-a4f4-2f757f32de7a" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-226b4071-b053-4aaa-a5e5-eb5e01b0599b tempest-CreateVolumesFromImageTest-1148490772 None] Lock "cinder-quobyte-2d7f50ae-aaee-4691-a4f4-2f757f32de7a" acquired by "delete_volume" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:50 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7ecb96-975f-43b8-a010-29f98098f461]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:21:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-226b4071-b053-4aaa-a5e5-eb5e01b0599b tempest-CreateVolumesFromImageTest-1148490772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2d7f50ae-aaee-4691-a4f4-2f757f32de7a {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:51 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2d7f50ae-aaee-4691-a4f4-2f757f32de7a Nov 03 13:21:51 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:51 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-226b4071-b053-4aaa-a5e5-eb5e01b0599b tempest-CreateVolumesFromImageTest-1148490772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2d7f50ae-aaee-4691-a4f4-2f757f32de7a" returned: 0 in 0.420s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-226b4071-b053-4aaa-a5e5-eb5e01b0599b tempest-CreateVolumesFromImageTest-1148490772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2d7f50ae-aaee-4691-a4f4-2f757f32de7a {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:51 devstack sudo[102552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2d7f50ae-aaee-4691-a4f4-2f757f32de7a Nov 03 13:21:51 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:51 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-226b4071-b053-4aaa-a5e5-eb5e01b0599b tempest-CreateVolumesFromImageTest-1148490772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-2d7f50ae-aaee-4691-a4f4-2f757f32de7a" returned: 0 in 0.246s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-226b4071-b053-4aaa-a5e5-eb5e01b0599b tempest-CreateVolumesFromImageTest-1148490772 None] Lock "cinder-quobyte-2d7f50ae-aaee-4691-a4f4-2f757f32de7a" released by "delete_volume" :: held 0.715s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:51 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-226b4071-b053-4aaa-a5e5-eb5e01b0599b tempest-CreateVolumesFromImageTest-1148490772 None] Created reservations ['7335b3a1-8ce0-492d-85f0-39a1fe338c40', '0d848502-cdf7-4f0b-9f0e-e94611a4bba3', '254d6c20-28a7-4f58-8513-4f0ed24e8610', 'a72df413-f11a-4dd4-80c6-b1f3b4f51b0a'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:21:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-226b4071-b053-4aaa-a5e5-eb5e01b0599b tempest-CreateVolumesFromImageTest-1148490772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-226b4071-b053-4aaa-a5e5-eb5e01b0599b tempest-CreateVolumesFromImageTest-1148490772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-226b4071-b053-4aaa-a5e5-eb5e01b0599b tempest-CreateVolumesFromImageTest-1148490772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-226b4071-b053-4aaa-a5e5-eb5e01b0599b tempest-CreateVolumesFromImageTest-1148490772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-226b4071-b053-4aaa-a5e5-eb5e01b0599b tempest-CreateVolumesFromImageTest-1148490772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-226b4071-b053-4aaa-a5e5-eb5e01b0599b tempest-CreateVolumesFromImageTest-1148490772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:51 devstack sudo[102555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:21:51 devstack sudo[102555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:52 devstack sudo[102555]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-226b4071-b053-4aaa-a5e5-eb5e01b0599b tempest-CreateVolumesFromImageTest-1148490772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.264s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:52 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-226b4071-b053-4aaa-a5e5-eb5e01b0599b tempest-CreateVolumesFromImageTest-1148490772 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:21:52 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-226b4071-b053-4aaa-a5e5-eb5e01b0599b tempest-CreateVolumesFromImageTest-1148490772 None] Deleted volume successfully. Nov 03 13:21:52 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-226b4071-b053-4aaa-a5e5-eb5e01b0599b tempest-CreateVolumesFromImageTest-1148490772 None] Lock "cinder-2d7f50ae-aaee-4691-a4f4-2f757f32de7a-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:55 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:21:55 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] Flow 'volume_create_manager' (eba13b3b-cea4-4c5c-98a7-3ffae5f60fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:21:55 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9fa4c0e-f862-4ec1-acbd-77b47baca504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:55 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9fa4c0e-f862-4ec1-acbd-77b47baca504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2073353782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=837949bd-63fc-43b2-b751-6e8b2ff5436d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e91da703af4242fda1cae8e64b72cf1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:21:56Z,use_quota=True,user_id='c5c348426e644c74bac0f98155aed780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:55 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c10cd8-d591-4715-8c33-4f7a1bf096da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:55 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c10cd8-d591-4715-8c33-4f7a1bf096da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:55 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae283bf1-1b2e-4eed-8cb6-143ab8a326e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:55 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae283bf1-1b2e-4eed-8cb6-143ab8a326e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '837949bd-63fc-43b2-b751-6e8b2ff5436d', 'volume_name': 'volume-837949bd-63fc-43b2-b751-6e8b2ff5436d', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:55 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d074b2a-82fe-4e20-997f-ed8c514f4abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:55 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d074b2a-82fe-4e20-997f-ed8c514f4abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:55 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c66bd2-c2ea-44c0-a57c-dcf3bc84e92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:55 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] Volume 837949bd-63fc-43b2-b751-6e8b2ff5436d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-837949bd-63fc-43b2-b751-6e8b2ff5436d', 'volume_size': 1} Nov 03 13:21:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:55 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2073353782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=837949bd-63fc-43b2-b751-6e8b2ff5436d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e91da703af4242fda1cae8e64b72cf1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:21:56Z,use_quota=True,user_id='c5c348426e644c74bac0f98155aed780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:21:55 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] Creating volume 837949bd-63fc-43b2-b751-6e8b2ff5436d {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:21:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:55 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:55 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:55 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:21:55 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:21:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-837949bd-63fc-43b2-b751-6e8b2ff5436d 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:55 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-837949bd-63fc-43b2-b751-6e8b2ff5436d 1073741824 Nov 03 13:21:55 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:56 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-837949bd-63fc-43b2-b751-6e8b2ff5436d 1073741824" returned: 0 in 0.465s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-837949bd-63fc-43b2-b751-6e8b2ff5436d {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:56 devstack sudo[102571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-837949bd-63fc-43b2-b751-6e8b2ff5436d Nov 03 13:21:56 devstack sudo[102571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:56 devstack sudo[102571]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-837949bd-63fc-43b2-b751-6e8b2ff5436d" returned: 0 in 0.304s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:56 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:21:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c66bd2-c2ea-44c0-a57c-dcf3bc84e92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-837949bd-63fc-43b2-b751-6e8b2ff5436d', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d105f78-59c5-4e6b-9cea-ef0941783dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:56 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] Volume volume-837949bd-63fc-43b2-b751-6e8b2ff5436d (837949bd-63fc-43b2-b751-6e8b2ff5436d): created successfully Nov 03 13:21:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d105f78-59c5-4e6b-9cea-ef0941783dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] Flow 'volume_create_manager' (eba13b3b-cea4-4c5c-98a7-3ffae5f60fa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:21:56 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-42cf0917-647b-44ce-aee4-3f4e7d52bb5c tempest-ProjectReaderTests-1216731336 None] Created volume successfully. Nov 03 13:21:57 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d87522ed-d7a6-406b-8191-c83c86d66438 tempest-ProjectReaderTests-1216731336 None] Acquiring lock "cinder-837949bd-63fc-43b2-b751-6e8b2ff5436d-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:57 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d87522ed-d7a6-406b-8191-c83c86d66438 tempest-ProjectReaderTests-1216731336 None] Lock "cinder-837949bd-63fc-43b2-b751-6e8b2ff5436d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:58 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d87522ed-d7a6-406b-8191-c83c86d66438 tempest-ProjectReaderTests-1216731336 None] Acquiring lock "cinder-quobyte-837949bd-63fc-43b2-b751-6e8b2ff5436d" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:21:58 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d87522ed-d7a6-406b-8191-c83c86d66438 tempest-ProjectReaderTests-1216731336 None] Lock "cinder-quobyte-837949bd-63fc-43b2-b751-6e8b2ff5436d" acquired by "delete_volume" :: waited 0.019s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:21:58 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[8573e4a8-8589-40cf-8196-fe77b55bc851]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:21:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d87522ed-d7a6-406b-8191-c83c86d66438 tempest-ProjectReaderTests-1216731336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-837949bd-63fc-43b2-b751-6e8b2ff5436d {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:58 devstack sudo[102574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-837949bd-63fc-43b2-b751-6e8b2ff5436d Nov 03 13:21:58 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:58 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d87522ed-d7a6-406b-8191-c83c86d66438 tempest-ProjectReaderTests-1216731336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-837949bd-63fc-43b2-b751-6e8b2ff5436d" returned: 0 in 0.370s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d87522ed-d7a6-406b-8191-c83c86d66438 tempest-ProjectReaderTests-1216731336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-837949bd-63fc-43b2-b751-6e8b2ff5436d {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:58 devstack sudo[102579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-837949bd-63fc-43b2-b751-6e8b2ff5436d Nov 03 13:21:58 devstack sudo[102579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:58 devstack sudo[102579]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d87522ed-d7a6-406b-8191-c83c86d66438 tempest-ProjectReaderTests-1216731336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-837949bd-63fc-43b2-b751-6e8b2ff5436d" returned: 0 in 0.248s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:58 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d87522ed-d7a6-406b-8191-c83c86d66438 tempest-ProjectReaderTests-1216731336 None] Lock "cinder-quobyte-837949bd-63fc-43b2-b751-6e8b2ff5436d" released by "delete_volume" :: held 0.674s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:58 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-d87522ed-d7a6-406b-8191-c83c86d66438 tempest-ProjectReaderTests-1216731336 None] Created reservations ['69fbf70e-63e2-4f29-b077-8d2fb25aa64f', '055cf2c5-6594-44f4-adc3-6c5b9a909ab8', '99a14ff9-2bcb-405c-9fa8-698d2ca18429', 'af583de3-573c-41ee-9d91-22cd04312a38'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:21:58 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:21:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:58 devstack sudo[102582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:21:58 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d87522ed-d7a6-406b-8191-c83c86d66438 tempest-ProjectReaderTests-1216731336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d87522ed-d7a6-406b-8191-c83c86d66438 tempest-ProjectReaderTests-1216731336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d87522ed-d7a6-406b-8191-c83c86d66438 tempest-ProjectReaderTests-1216731336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d87522ed-d7a6-406b-8191-c83c86d66438 tempest-ProjectReaderTests-1216731336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d87522ed-d7a6-406b-8191-c83c86d66438 tempest-ProjectReaderTests-1216731336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d87522ed-d7a6-406b-8191-c83c86d66438 tempest-ProjectReaderTests-1216731336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:58 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:21:58 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:21:59 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.283s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:59 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:21:59 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager._thread_info {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:21:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread count: 28 {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:21:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread info: [<_MainThread(MainThread, started 133507074375808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:21:59 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Nov 03 13:21:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d87522ed-d7a6-406b-8191-c83c86d66438 tempest-ProjectReaderTests-1216731336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.283s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:21:59 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-d87522ed-d7a6-406b-8191-c83c86d66438 tempest-ProjectReaderTests-1216731336 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:21:59 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-d87522ed-d7a6-406b-8191-c83c86d66438 tempest-ProjectReaderTests-1216731336 None] Deleted volume successfully. Nov 03 13:21:59 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d87522ed-d7a6-406b-8191-c83c86d66438 tempest-ProjectReaderTests-1216731336 None] Lock "cinder-837949bd-63fc-43b2-b751-6e8b2ff5436d-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:21:59 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:21:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] Flow 'volume_create_manager' (5b422b28-fd1b-4ce5-b7cf-19d0001929ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:21:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d94cc37-4b6f-47fa-8c63-f6f80cbf861c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d94cc37-4b6f-47fa-8c63-f6f80cbf861c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-12716603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3809353-a086-4da8-ae65-287433cc1f44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e91da703af4242fda1cae8e64b72cf1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:22:00Z,use_quota=True,user_id='c5c348426e644c74bac0f98155aed780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cef1f51-2dcd-405c-b50c-e5851c43948f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cef1f51-2dcd-405c-b50c-e5851c43948f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93bfc871-7a92-4ea7-acdf-3b118f19f074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93bfc871-7a92-4ea7-acdf-3b118f19f074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3809353-a086-4da8-ae65-287433cc1f44', 'volume_name': 'volume-b3809353-a086-4da8-ae65-287433cc1f44', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db3d8393-567a-44d8-af8e-133cf04909ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db3d8393-567a-44d8-af8e-133cf04909ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:21:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d0615a-2da1-4ec0-ae12-978722ba13cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:21:59 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] Volume b3809353-a086-4da8-ae65-287433cc1f44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3809353-a086-4da8-ae65-287433cc1f44', 'volume_size': 1} Nov 03 13:21:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:59 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-12716603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3809353-a086-4da8-ae65-287433cc1f44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e91da703af4242fda1cae8e64b72cf1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:22:00Z,use_quota=True,user_id='c5c348426e644c74bac0f98155aed780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:21:59 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] Creating volume b3809353-a086-4da8-ae65-287433cc1f44 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:21:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:21:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:21:59 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:21:59 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:21:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:21:59 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:21:59 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:21:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3809353-a086-4da8-ae65-287433cc1f44 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:21:59 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3809353-a086-4da8-ae65-287433cc1f44 1073741824 Nov 03 13:21:59 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:22:00 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Nov 03 13:22:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3809353-a086-4da8-ae65-287433cc1f44 1073741824" returned: 0 in 0.476s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:22:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3809353-a086-4da8-ae65-287433cc1f44 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:22:00 devstack sudo[102593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3809353-a086-4da8-ae65-287433cc1f44 Nov 03 13:22:00 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:22:00 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root Nov 03 13:22:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3809353-a086-4da8-ae65-287433cc1f44" returned: 0 in 0.257s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:22:00 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:22:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:22:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d0615a-2da1-4ec0-ae12-978722ba13cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3809353-a086-4da8-ae65-287433cc1f44', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:22:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a0e5b40-0c25-44a6-80ec-ab7cc178f78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:22:00 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] Volume volume-b3809353-a086-4da8-ae65-287433cc1f44 (b3809353-a086-4da8-ae65-287433cc1f44): created successfully Nov 03 13:22:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a0e5b40-0c25-44a6-80ec-ab7cc178f78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:22:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] Flow 'volume_create_manager' (5b422b28-fd1b-4ce5-b7cf-19d0001929ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:22:00 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-52a40941-d692-4737-971e-261ce7fa6008 tempest-ProjectReaderTests-1216731336 None] Created volume successfully. Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] Flow 'volume_create_manager' (1a22aa75-14f2-4b50-8cc8-1775f2aa7b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49772a4e-d114-4f91-a0fb-88a6fe525278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49772a4e-d114-4f91-a0fb-88a6fe525278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2016890435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6c6ac87-178e-47d4-bfa8-40f6a74e799a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51e4abc45d994936b8fa15909f5994d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:22:01Z,use_quota=True,user_id='91a551e80c1a46d48170b2032f004498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87810b03-2603-43b8-bfe5-a73f393f1143),volume_type_id=87810b03-2603-43b8-bfe5-a73f393f1143)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bfef356-c661-460e-92df-2e2bdf10032e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bfef356-c661-460e-92df-2e2bdf10032e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (177563a3-80ab-492f-9423-1ed83f76c9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (177563a3-80ab-492f-9423-1ed83f76c9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6c6ac87-178e-47d4-bfa8-40f6a74e799a', 'volume_name': 'volume-b6c6ac87-178e-47d4-bfa8-40f6a74e799a', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b5ea45-0e05-46f4-9b6b-c7653029823a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b5ea45-0e05-46f4-9b6b-c7653029823a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d932272-c68d-4809-a4cf-701857d962eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:22:01 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] Volume b6c6ac87-178e-47d4-bfa8-40f6a74e799a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6c6ac87-178e-47d4-bfa8-40f6a74e799a', 'volume_size': 1} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2016890435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6c6ac87-178e-47d4-bfa8-40f6a74e799a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51e4abc45d994936b8fa15909f5994d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:22:01Z,use_quota=True,user_id='91a551e80c1a46d48170b2032f004498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87810b03-2603-43b8-bfe5-a73f393f1143),volume_type_id=87810b03-2603-43b8-bfe5-a73f393f1143)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] Creating volume b6c6ac87-178e-47d4-bfa8-40f6a74e799a {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:22:01 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b6c6ac87-178e-47d4-bfa8-40f6a74e799a 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:22:01 devstack sudo[102596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b6c6ac87-178e-47d4-bfa8-40f6a74e799a 1073741824 Nov 03 13:22:01 devstack sudo[102596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] Flow 'volume_create_manager' (e853bc04-e330-4c15-a9e4-e6b218c22285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (667f1959-d8a6-4ddd-b594-866339c4406b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (667f1959-d8a6-4ddd-b594-866339c4406b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-939102284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42e6764b-4cac-4aff-bb36-d6a78ca85695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51e4abc45d994936b8fa15909f5994d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:22:01Z,use_quota=True,user_id='91a551e80c1a46d48170b2032f004498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a38dea50-3a36-4af6-8956-34a6fa8cf1a2),volume_type_id=a38dea50-3a36-4af6-8956-34a6fa8cf1a2)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beda8f09-d4ac-49d9-822f-844cc203c5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beda8f09-d4ac-49d9-822f-844cc203c5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17ef2460-d9b2-4227-a04b-f42fc6de5e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17ef2460-d9b2-4227-a04b-f42fc6de5e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42e6764b-4cac-4aff-bb36-d6a78ca85695', 'volume_name': 'volume-42e6764b-4cac-4aff-bb36-d6a78ca85695', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db32d9b5-2830-4db0-a3e6-abeda85de327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db32d9b5-2830-4db0-a3e6-abeda85de327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34b205fa-8f54-43a2-80f9-4d3f22f3a2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:22:01 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] Volume 42e6764b-4cac-4aff-bb36-d6a78ca85695: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42e6764b-4cac-4aff-bb36-d6a78ca85695', 'volume_size': 1} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:22:01 devstack sudo[102596]: pam_unix(sudo:session): session closed for user root Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b6c6ac87-178e-47d4-bfa8-40f6a74e799a 1073741824" returned: 0 in 0.504s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-de7c48b9-7556-467e-b4c7-66896e5e9734 tempest-ProjectReaderTests-1216731336 None] Acquiring lock "cinder-b3809353-a086-4da8-ae65-287433cc1f44-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-de7c48b9-7556-467e-b4c7-66896e5e9734 tempest-ProjectReaderTests-1216731336 None] Lock "cinder-b3809353-a086-4da8-ae65-287433cc1f44-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b6c6ac87-178e-47d4-bfa8-40f6a74e799a {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:22:01 devstack sudo[102602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b6c6ac87-178e-47d4-bfa8-40f6a74e799a Nov 03 13:22:01 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-de7c48b9-7556-467e-b4c7-66896e5e9734 tempest-ProjectReaderTests-1216731336 None] Acquiring lock "cinder-quobyte-b3809353-a086-4da8-ae65-287433cc1f44" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-de7c48b9-7556-467e-b4c7-66896e5e9734 tempest-ProjectReaderTests-1216731336 None] Lock "cinder-quobyte-b3809353-a086-4da8-ae65-287433cc1f44" acquired by "delete_volume" :: waited 0.026s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8558ed-7f5b-412e-9aec-240dfd835c31]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:22:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-de7c48b9-7556-467e-b4c7-66896e5e9734 tempest-ProjectReaderTests-1216731336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3809353-a086-4da8-ae65-287433cc1f44 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:22:02 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3809353-a086-4da8-ae65-287433cc1f44 Nov 03 13:22:02 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:22:02 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b6c6ac87-178e-47d4-bfa8-40f6a74e799a" returned: 0 in 0.322s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.491s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-939102284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42e6764b-4cac-4aff-bb36-d6a78ca85695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51e4abc45d994936b8fa15909f5994d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:22:01Z,use_quota=True,user_id='91a551e80c1a46d48170b2032f004498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a38dea50-3a36-4af6-8956-34a6fa8cf1a2),volume_type_id=a38dea50-3a36-4af6-8956-34a6fa8cf1a2)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] Creating volume 42e6764b-4cac-4aff-bb36-d6a78ca85695 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:22:02 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-42e6764b-4cac-4aff-bb36-d6a78ca85695 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d932272-c68d-4809-a4cf-701857d962eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6c6ac87-178e-47d4-bfa8-40f6a74e799a', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:22:02 devstack sudo[102607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-42e6764b-4cac-4aff-bb36-d6a78ca85695 1073741824 Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc09b83-82c7-4e95-997a-592becd23d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:22:02 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Flow 'volume_create_manager' (87207a55-8d50-4b27-a232-da86d5103012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f71cb8d-8a83-4b4c-8af3-ef5da4f8c0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f71cb8d-8a83-4b4c-8af3-ef5da4f8c0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-600317006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11182734-edea-4f65-b312-d143fd1571fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51e4abc45d994936b8fa15909f5994d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:22:02Z,use_quota=True,user_id='91a551e80c1a46d48170b2032f004498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a6fe7d1-d45a-4b31-8568-d53cb9ffcf80),volume_type_id=5a6fe7d1-d45a-4b31-8568-d53cb9ffcf80)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee404acb-7f37-49a6-a035-3d38b5669d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee404acb-7f37-49a6-a035-3d38b5669d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ff8120f-7c39-4fcc-abea-650792966640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG cinder.image.glance [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Creating Keystone auth plugin from conf {{(pid=86725) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 13:22:02 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] Volume volume-b6c6ac87-178e-47d4-bfa8-40f6a74e799a (b6c6ac87-178e-47d4-bfa8-40f6a74e799a): created successfully Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc09b83-82c7-4e95-997a-592becd23d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] Flow 'volume_create_manager' (1a22aa75-14f2-4b50-8cc8-1775f2aa7b6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:22:02 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-d94d3351-86de-4767-a95c-7b5e29936991 tempest-TestInstancesWithCinderVolumes-155088745 None] Created volume successfully. Nov 03 13:22:02 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-de7c48b9-7556-467e-b4c7-66896e5e9734 tempest-ProjectReaderTests-1216731336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3809353-a086-4da8-ae65-287433cc1f44" returned: 0 in 0.409s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-de7c48b9-7556-467e-b4c7-66896e5e9734 tempest-ProjectReaderTests-1216731336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3809353-a086-4da8-ae65-287433cc1f44 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:22:02 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3809353-a086-4da8-ae65-287433cc1f44 Nov 03 13:22:02 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ff8120f-7c39-4fcc-abea-650792966640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '11182734-edea-4f65-b312-d143fd1571fb', 'volume_name': 'volume-11182734-edea-4f65-b312-d143fd1571fb', 'volume_size': 1, 'image_id': 'e7481921-1626-4ba0-9925-657e9eaa898e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e7481921-1626-4ba0-9925-657e9eaa898e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1993364144', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '51e4abc45d994936b8fa15909f5994d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e7481921-1626-4ba0-9925-657e9eaa898e', 'created_at': datetime.datetime(2026, 11, 3, 12, 21, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e7481921-1626-4ba0-9925-657e9eaa898e/file', 'properties': {}}, 'image_service': }' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d58b4f62-2b8c-4be0-995b-5c5b8c652ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d58b4f62-2b8c-4be0-995b-5c5b8c652ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba93b1c7-c535-4bd8-bc75-ebcd31e3da1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:22:02 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Volume 11182734-edea-4f65-b312-d143fd1571fb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-11182734-edea-4f65-b312-d143fd1571fb', 'volume_size': 1, 'image_id': 'e7481921-1626-4ba0-9925-657e9eaa898e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e7481921-1626-4ba0-9925-657e9eaa898e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1993364144', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '51e4abc45d994936b8fa15909f5994d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e7481921-1626-4ba0-9925-657e9eaa898e', 'created_at': datetime.datetime(2026, 11, 3, 12, 21, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e7481921-1626-4ba0-9925-657e9eaa898e/file', 'properties': {}}, 'image_service': } Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Trying to clone 11182734-edea-4f65-b312-d143fd1571fb from image e7481921-1626-4ba0-9925-657e9eaa898e at location (None, [{'url': 'file:///opt/stack/data/glance/images/e7481921-1626-4ba0-9925-657e9eaa898e', 'metadata': {}}]). {{(pid=86725) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 13:22:02 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-de7c48b9-7556-467e-b4c7-66896e5e9734 tempest-ProjectReaderTests-1216731336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3809353-a086-4da8-ae65-287433cc1f44" returned: 0 in 0.284s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:22:02 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-de7c48b9-7556-467e-b4c7-66896e5e9734 tempest-ProjectReaderTests-1216731336 None] Lock "cinder-quobyte-b3809353-a086-4da8-ae65-287433cc1f44" released by "delete_volume" :: held 0.751s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-42e6764b-4cac-4aff-bb36-d6a78ca85695 1073741824" returned: 0 in 0.494s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-42e6764b-4cac-4aff-bb36-d6a78ca85695 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:22:02 devstack sudo[102619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-42e6764b-4cac-4aff-bb36-d6a78ca85695 Nov 03 13:22:02 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-de7c48b9-7556-467e-b4c7-66896e5e9734 tempest-ProjectReaderTests-1216731336 None] Created reservations ['adc18302-3917-47d6-bada-1a5a6411b4e4', '7ae0068e-9c79-43d7-8e7c-c9e11b0f4d4e', 'f5f72ae5-62ad-47e6-9e7c-2c1de908eb0c', 'f5776013-fa78-4fcd-950d-87695232cac8'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-de7c48b9-7556-467e-b4c7-66896e5e9734 tempest-ProjectReaderTests-1216731336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-de7c48b9-7556-467e-b4c7-66896e5e9734 tempest-ProjectReaderTests-1216731336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-de7c48b9-7556-467e-b4c7-66896e5e9734 tempest-ProjectReaderTests-1216731336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-de7c48b9-7556-467e-b4c7-66896e5e9734 tempest-ProjectReaderTests-1216731336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-de7c48b9-7556-467e-b4c7-66896e5e9734 tempest-ProjectReaderTests-1216731336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-de7c48b9-7556-467e-b4c7-66896e5e9734 tempest-ProjectReaderTests-1216731336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:22:02 devstack sudo[102621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:22:02 devstack sudo[102621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:22:02 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-42e6764b-4cac-4aff-bb36-d6a78ca85695" returned: 0 in 0.282s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34b205fa-8f54-43a2-80f9-4d3f22f3a2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42e6764b-4cac-4aff-bb36-d6a78ca85695', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:22:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aabfb9a-64c0-4c98-bf3d-7e27de07e164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:22:03 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] Volume volume-42e6764b-4cac-4aff-bb36-d6a78ca85695 (42e6764b-4cac-4aff-bb36-d6a78ca85695): created successfully Nov 03 13:22:03 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aabfb9a-64c0-4c98-bf3d-7e27de07e164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:22:03 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] Flow 'volume_create_manager' (e853bc04-e330-4c15-a9e4-e6b218c22285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:22:03 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-f96443da-acb0-423f-ae1d-2cc634f82577 tempest-TestInstancesWithCinderVolumes-155088745 None] Created volume successfully. Nov 03 13:22:03 devstack sudo[102621]: pam_unix(sudo:session): session closed for user root Nov 03 13:22:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-de7c48b9-7556-467e-b4c7-66896e5e9734 tempest-ProjectReaderTests-1216731336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.300s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:22:03 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-de7c48b9-7556-467e-b4c7-66896e5e9734 tempest-ProjectReaderTests-1216731336 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:22:03 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-de7c48b9-7556-467e-b4c7-66896e5e9734 tempest-ProjectReaderTests-1216731336 None] Deleted volume successfully. Nov 03 13:22:03 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-de7c48b9-7556-467e-b4c7-66896e5e9734 tempest-ProjectReaderTests-1216731336 None] Lock "cinder-b3809353-a086-4da8-ae65-287433cc1f44-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:22:05 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e7481921-1626-4ba0-9925-657e9eaa898e_l_0e13d_devstack@QuobyteHD, size 20.69 MB, duration 3.27 sec {{(pid=86725) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 13:22:05 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Image download 20.69 MB at 6.32 MB/s Nov 03 13:22:05 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fd2b47-d1f2-4951-a48f-3df4131151de]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:22:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e7481921-1626-4ba0-9925-657e9eaa898e_l_0e13d_devstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:22:05 devstack sudo[102625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e7481921-1626-4ba0-9925-657e9eaa898e_l_0e13d_devstack@QuobyteHD Nov 03 13:22:05 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:22:06 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root Nov 03 13:22:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e7481921-1626-4ba0-9925-657e9eaa898e_l_0e13d_devstack@QuobyteHD" returned: 0 in 0.326s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:22:06 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Temporary image e7481921-1626-4ba0-9925-657e9eaa898e is fetched for user 91a551e80c1a46d48170b2032f004498. {{(pid=86725) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 13:22:06 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[146efd84-1e99-4658-a418-978c783a4251]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:22:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e7481921-1626-4ba0-9925-657e9eaa898e_l_0e13d_devstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:22:06 devstack sudo[102631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e7481921-1626-4ba0-9925-657e9eaa898e_l_0e13d_devstack@QuobyteHD Nov 03 13:22:06 devstack sudo[102631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:22:06 devstack sudo[102631]: pam_unix(sudo:session): session closed for user root Nov 03 13:22:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e7481921-1626-4ba0-9925-657e9eaa898e_l_0e13d_devstack@QuobyteHD" returned: 0 in 0.322s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:22:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:22:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:22:06 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-600317006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11182734-edea-4f65-b312-d143fd1571fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51e4abc45d994936b8fa15909f5994d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:22:02Z,use_quota=True,user_id='91a551e80c1a46d48170b2032f004498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a6fe7d1-d45a-4b31-8568-d53cb9ffcf80),volume_type_id=5a6fe7d1-d45a-4b31-8568-d53cb9ffcf80)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:22:06 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Creating volume 11182734-edea-4f65-b312-d143fd1571fb {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:22:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:22:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:22:06 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:22:06 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:22:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:22:06 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:22:06 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:22:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-11182734-edea-4f65-b312-d143fd1571fb 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:22:06 devstack sudo[102636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-11182734-edea-4f65-b312-d143fd1571fb 1073741824 Nov 03 13:22:06 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:22:06 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root Nov 03 13:22:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-11182734-edea-4f65-b312-d143fd1571fb 1073741824" returned: 0 in 0.397s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:22:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-11182734-edea-4f65-b312-d143fd1571fb {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:22:07 devstack sudo[102641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-11182734-edea-4f65-b312-d143fd1571fb Nov 03 13:22:07 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:22:07 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root Nov 03 13:22:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-11182734-edea-4f65-b312-d143fd1571fb" returned: 0 in 0.238s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:22:07 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:22:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:22:07 devstack cinder-volume[86725]: DEBUG cinder.volume.volume_utils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Attempting download of e7481921-1626-4ba0-9925-657e9eaa898e ((None, [{'url': 'file:///opt/stack/data/glance/images/e7481921-1626-4ba0-9925-657e9eaa898e', 'metadata': {}}])) to volume 11182734-edea-4f65-b312-d143fd1571fb. {{(pid=86725) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 13:22:07 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[e973d028-d84f-49fb-9d7c-0d0c41295c51]: (4, 'raw') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:22:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e7481921-1626-4ba0-9925-657e9eaa898e__qqo_5lh {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:22:07 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e7481921-1626-4ba0-9925-657e9eaa898e__qqo_5lh Nov 03 13:22:07 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:22:07 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Nov 03 13:22:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e7481921-1626-4ba0-9925-657e9eaa898e__qqo_5lh" returned: 0 in 0.323s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:22:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7481921-1626-4ba0-9925-657e9eaa898e__qqo_5lh {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:22:07 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7481921-1626-4ba0-9925-657e9eaa898e__qqo_5lh Nov 03 13:22:07 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:22:07 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Nov 03 13:22:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7481921-1626-4ba0-9925-657e9eaa898e__qqo_5lh" returned: 1 in 0.315s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:22:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7481921-1626-4ba0-9925-657e9eaa898e__qqo_5lh' failed. Not Retrying. {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:22:07 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a45e1b-a946-4adc-ade9-1b8a54642552]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:22:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e7481921-1626-4ba0-9925-657e9eaa898e_l_0e13d_devstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:22:08 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e7481921-1626-4ba0-9925-657e9eaa898e_l_0e13d_devstack@QuobyteHD Nov 03 13:22:08 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:22:08 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Nov 03 13:22:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e7481921-1626-4ba0-9925-657e9eaa898e_l_0e13d_devstack@QuobyteHD" returned: 0 in 0.334s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:22:08 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] e7481921-1626-4ba0-9925-657e9eaa898e was qcow2, converting to qcow2 {{(pid=86725) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 13:22:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e7481921-1626-4ba0-9925-657e9eaa898e_l_0e13d_devstack@QuobyteHD /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-11182734-edea-4f65-b312-d143fd1571fb {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:22:08 devstack sudo[102657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e7481921-1626-4ba0-9925-657e9eaa898e_l_0e13d_devstack@QuobyteHD /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-11182734-edea-4f65-b312-d143fd1571fb Nov 03 13:22:08 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:22:09 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root Nov 03 13:22:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e7481921-1626-4ba0-9925-657e9eaa898e_l_0e13d_devstack@QuobyteHD /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-11182734-edea-4f65-b312-d143fd1571fb" returned: 0 in 1.675s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:22:09 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e7481921-1626-4ba0-9925-657e9eaa898e_l_0e13d_devstack@QuobyteHD, size 112.00 MB, duration 1.68 sec, destination /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-11182734-edea-4f65-b312-d143fd1571fb {{(pid=86725) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:22:09 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Converted 112.00 MB image at 66.82 MB/s Nov 03 13:22:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-11182734-edea-4f65-b312-d143fd1571fb 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:22:10 devstack sudo[102668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-11182734-edea-4f65-b312-d143fd1571fb 1G Nov 03 13:22:10 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:22:10 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root Nov 03 13:22:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-11182734-edea-4f65-b312-d143fd1571fb 1G" returned: 0 in 0.309s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:22:10 devstack cinder-volume[86725]: DEBUG cinder.volume.volume_utils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Downloaded image e7481921-1626-4ba0-9925-657e9eaa898e ((None, [{'url': 'file:///opt/stack/data/glance/images/e7481921-1626-4ba0-9925-657e9eaa898e', 'metadata': {}}])) to volume 11182734-edea-4f65-b312-d143fd1571fb successfully. {{(pid=86725) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 13:22:10 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Temporary image e7481921-1626-4ba0-9925-657e9eaa898e for user 91a551e80c1a46d48170b2032f004498 is deleted. {{(pid=86725) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 13:22:10 devstack cinder-volume[86725]: DEBUG cinder.volume.volume_utils [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Marking volume 11182734-edea-4f65-b312-d143fd1571fb as bootable. {{(pid=86725) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 13:22:10 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Copying metadata from image e7481921-1626-4ba0-9925-657e9eaa898e to 11182734-edea-4f65-b312-d143fd1571fb. {{(pid=86725) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 13:22:10 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Creating volume glance metadata for volume 11182734-edea-4f65-b312-d143fd1571fb backed by image e7481921-1626-4ba0-9925-657e9eaa898e with: {'image_id': 'e7481921-1626-4ba0-9925-657e9eaa898e', 'image_name': 'tempest-scenario-img--1993364144', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86725) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 13:22:10 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba93b1c7-c535-4bd8-bc75-ebcd31e3da1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11182734-edea-4f65-b312-d143fd1571fb', 'volume_size': 1, 'image_id': 'e7481921-1626-4ba0-9925-657e9eaa898e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e7481921-1626-4ba0-9925-657e9eaa898e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1993364144', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '51e4abc45d994936b8fa15909f5994d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e7481921-1626-4ba0-9925-657e9eaa898e', 'created_at': datetime.datetime(2026, 11, 3, 12, 21, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e7481921-1626-4ba0-9925-657e9eaa898e/file', 'properties': {}}, 'image_service': }' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:22:10 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29ca0d3e-b43d-49bf-b4ab-5ca468a4c75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:22:10 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Volume volume-11182734-edea-4f65-b312-d143fd1571fb (11182734-edea-4f65-b312-d143fd1571fb): created successfully Nov 03 13:22:10 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29ca0d3e-b43d-49bf-b4ab-5ca468a4c75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:22:10 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Flow 'volume_create_manager' (87207a55-8d50-4b27-a232-da86d5103012) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:22:10 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-edba5c89-df98-4fe0-bb4e-40cdbded2459 tempest-TestInstancesWithCinderVolumes-155088745 None] Created volume successfully. Nov 03 13:22:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-041ce3f5-c34f-4bc7-b023-af3255193571 req-dd95470d-df82-44e0-8d81-ecd59b64dbad tempest-TestInstancesWithCinderVolumes-155088745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:22:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-041ce3f5-c34f-4bc7-b023-af3255193571 req-dd95470d-df82-44e0-8d81-ecd59b64dbad tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:22:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-041ce3f5-c34f-4bc7-b023-af3255193571 req-dd95470d-df82-44e0-8d81-ecd59b64dbad tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:22:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-041ce3f5-c34f-4bc7-b023-af3255193571 req-dd95470d-df82-44e0-8d81-ecd59b64dbad tempest-TestInstancesWithCinderVolumes-155088745 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43', 'name': 'volume-11182734-edea-4f65-b312-d143fd1571fb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2f51c7f9-5564-4130-a422-c41e4826320d', 'enforce_multipath': True} {{(pid=86725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:22:13 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-041ce3f5-c34f-4bc7-b023-af3255193571 req-dd95470d-df82-44e0-8d81-ecd59b64dbad tempest-TestInstancesWithCinderVolumes-155088745 None] attachment_update completed successfully. Nov 03 13:22:23 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:UPDATE=48,cinder:SELECT=42,cinder:DELETE=7,cinder:INSERT=19 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:22:23 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:UPDATE=62,cinder:SELECT=45,cinder:INSERT=11,cinder:DELETE=3 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:22:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-587f369f-839c-4191-846d-69ae9334900e req-e38efe6a-0afd-46a5-8b6a-3fe692e12fb8 tempest-TestInstancesWithCinderVolumes-155088745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:22:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-587f369f-839c-4191-846d-69ae9334900e req-e38efe6a-0afd-46a5-8b6a-3fe692e12fb8 tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:22:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-587f369f-839c-4191-846d-69ae9334900e req-e38efe6a-0afd-46a5-8b6a-3fe692e12fb8 tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:22:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-587f369f-839c-4191-846d-69ae9334900e req-e38efe6a-0afd-46a5-8b6a-3fe692e12fb8 tempest-TestInstancesWithCinderVolumes-155088745 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43', 'name': 'volume-b6c6ac87-178e-47d4-bfa8-40f6a74e799a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '48d74ca2-7db3-4649-935b-17efafcb5d2a', 'enforce_multipath': True} {{(pid=86725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:22:44 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-587f369f-839c-4191-846d-69ae9334900e req-e38efe6a-0afd-46a5-8b6a-3fe692e12fb8 tempest-TestInstancesWithCinderVolumes-155088745 None] attachment_update completed successfully. Nov 03 13:22:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-ac3615f5-8a91-4690-bba0-8d1f7ffb98eb req-d86f8249-e60b-406c-a1d3-276e4c6b9c83 tempest-TestInstancesWithCinderVolumes-155088745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:22:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-ac3615f5-8a91-4690-bba0-8d1f7ffb98eb req-d86f8249-e60b-406c-a1d3-276e4c6b9c83 tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:22:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-ac3615f5-8a91-4690-bba0-8d1f7ffb98eb req-d86f8249-e60b-406c-a1d3-276e4c6b9c83 tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:22:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-ac3615f5-8a91-4690-bba0-8d1f7ffb98eb req-d86f8249-e60b-406c-a1d3-276e4c6b9c83 tempest-TestInstancesWithCinderVolumes-155088745 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43', 'name': 'volume-42e6764b-4cac-4aff-bb36-d6a78ca85695', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cdb43c37-9664-4481-a1f5-074423921813', 'enforce_multipath': True} {{(pid=86725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:22:46 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-ac3615f5-8a91-4690-bba0-8d1f7ffb98eb req-d86f8249-e60b-406c-a1d3-276e4c6b9c83 tempest-TestInstancesWithCinderVolumes-155088745 None] attachment_update completed successfully. Nov 03 13:22:50 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-de109580-dbd4-4973-928f-36b21b04c7e9 req-93ac7a4f-95fc-4187-81f3-89c6e9ba5119 tempest-TestInstancesWithCinderVolumes-155088745 None] Terminate volume connection completed successfully. Nov 03 13:22:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-de109580-dbd4-4973-928f-36b21b04c7e9 req-93ac7a4f-95fc-4187-81f3-89c6e9ba5119 tempest-TestInstancesWithCinderVolumes-155088745 None] Deleting attachment 48d74ca2-7db3-4649-935b-17efafcb5d2a. {{(pid=86725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:22:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-cd0fc588-8834-4ac5-ab50-11daadc5b45a tempest-TestInstancesWithCinderVolumes-155088745 None] Acquiring lock "cinder-b6c6ac87-178e-47d4-bfa8-40f6a74e799a-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:22:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-cd0fc588-8834-4ac5-ab50-11daadc5b45a tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "cinder-b6c6ac87-178e-47d4-bfa8-40f6a74e799a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:22:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-cd0fc588-8834-4ac5-ab50-11daadc5b45a tempest-TestInstancesWithCinderVolumes-155088745 None] Acquiring lock "cinder-quobyte-b6c6ac87-178e-47d4-bfa8-40f6a74e799a" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:22:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-cd0fc588-8834-4ac5-ab50-11daadc5b45a tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "cinder-quobyte-b6c6ac87-178e-47d4-bfa8-40f6a74e799a" acquired by "delete_volume" :: waited 0.014s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:22:51 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca403fe-87e5-4bf3-971e-af47828100db]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:22:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-cd0fc588-8834-4ac5-ab50-11daadc5b45a tempest-TestInstancesWithCinderVolumes-155088745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b6c6ac87-178e-47d4-bfa8-40f6a74e799a {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:22:51 devstack sudo[103332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b6c6ac87-178e-47d4-bfa8-40f6a74e799a Nov 03 13:22:51 devstack sudo[103332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:22:51 devstack sudo[103332]: pam_unix(sudo:session): session closed for user root Nov 03 13:22:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-cd0fc588-8834-4ac5-ab50-11daadc5b45a tempest-TestInstancesWithCinderVolumes-155088745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b6c6ac87-178e-47d4-bfa8-40f6a74e799a" returned: 0 in 0.383s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:22:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-cd0fc588-8834-4ac5-ab50-11daadc5b45a tempest-TestInstancesWithCinderVolumes-155088745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b6c6ac87-178e-47d4-bfa8-40f6a74e799a {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:22:51 devstack sudo[103337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b6c6ac87-178e-47d4-bfa8-40f6a74e799a Nov 03 13:22:51 devstack sudo[103337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:22:51 devstack sudo[103337]: pam_unix(sudo:session): session closed for user root Nov 03 13:22:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-cd0fc588-8834-4ac5-ab50-11daadc5b45a tempest-TestInstancesWithCinderVolumes-155088745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b6c6ac87-178e-47d4-bfa8-40f6a74e799a" returned: 0 in 0.278s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:22:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-cd0fc588-8834-4ac5-ab50-11daadc5b45a tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "cinder-quobyte-b6c6ac87-178e-47d4-bfa8-40f6a74e799a" released by "delete_volume" :: held 0.707s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:22:51 devstack cinder-volume[86725]: WARNING cinder.quota [None req-cd0fc588-8834-4ac5-ab50-11daadc5b45a tempest-TestInstancesWithCinderVolumes-155088745 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-428074421-1529432126 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-428074421-1529432126, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:22:51 devstack cinder-volume[86725]: WARNING cinder.quota [None req-cd0fc588-8834-4ac5-ab50-11daadc5b45a tempest-TestInstancesWithCinderVolumes-155088745 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-428074421-1529432126 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-428074421-1529432126, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:22:51 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-cd0fc588-8834-4ac5-ab50-11daadc5b45a tempest-TestInstancesWithCinderVolumes-155088745 None] Created reservations ['59b5aa5e-cb7f-4ad8-8976-eef6bd4b63b0', '89ddda0e-91ec-476a-9f22-c0419ed59b46', 'e54fca65-2f6a-4005-8280-5c88e1ad5a00', 'd86bea54-ef26-4cf9-8c40-5635a6b96757'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:22:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-cd0fc588-8834-4ac5-ab50-11daadc5b45a tempest-TestInstancesWithCinderVolumes-155088745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:22:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-cd0fc588-8834-4ac5-ab50-11daadc5b45a tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:22:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-cd0fc588-8834-4ac5-ab50-11daadc5b45a tempest-TestInstancesWithCinderVolumes-155088745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:22:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-cd0fc588-8834-4ac5-ab50-11daadc5b45a tempest-TestInstancesWithCinderVolumes-155088745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:22:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-cd0fc588-8834-4ac5-ab50-11daadc5b45a tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:22:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-cd0fc588-8834-4ac5-ab50-11daadc5b45a tempest-TestInstancesWithCinderVolumes-155088745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:22:52 devstack sudo[103340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:22:52 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:22:52 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root Nov 03 13:22:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-cd0fc588-8834-4ac5-ab50-11daadc5b45a tempest-TestInstancesWithCinderVolumes-155088745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.264s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:22:52 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-cd0fc588-8834-4ac5-ab50-11daadc5b45a tempest-TestInstancesWithCinderVolumes-155088745 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:22:52 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-cd0fc588-8834-4ac5-ab50-11daadc5b45a tempest-TestInstancesWithCinderVolumes-155088745 None] Deleted volume successfully. Nov 03 13:22:52 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-cd0fc588-8834-4ac5-ab50-11daadc5b45a tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "cinder-b6c6ac87-178e-47d4-bfa8-40f6a74e799a-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:22:54 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-deaf31d3-296d-4555-aa49-7eebc37146dd req-fcedf7d2-3807-42cc-932f-ccd497e960e5 tempest-TestInstancesWithCinderVolumes-155088745 None] Terminate volume connection completed successfully. Nov 03 13:22:54 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-deaf31d3-296d-4555-aa49-7eebc37146dd req-fcedf7d2-3807-42cc-932f-ccd497e960e5 tempest-TestInstancesWithCinderVolumes-155088745 None] Deleting attachment cdb43c37-9664-4481-a1f5-074423921813. {{(pid=86725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:22:55 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-ffdaa83b-1c45-4ba7-9b6b-b8c605474e57 tempest-TestInstancesWithCinderVolumes-155088745 None] Acquiring lock "cinder-42e6764b-4cac-4aff-bb36-d6a78ca85695-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:22:55 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-ffdaa83b-1c45-4ba7-9b6b-b8c605474e57 tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "cinder-42e6764b-4cac-4aff-bb36-d6a78ca85695-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:22:55 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-ffdaa83b-1c45-4ba7-9b6b-b8c605474e57 tempest-TestInstancesWithCinderVolumes-155088745 None] Acquiring lock "cinder-quobyte-42e6764b-4cac-4aff-bb36-d6a78ca85695" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:22:55 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-ffdaa83b-1c45-4ba7-9b6b-b8c605474e57 tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "cinder-quobyte-42e6764b-4cac-4aff-bb36-d6a78ca85695" acquired by "delete_volume" :: waited 0.015s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:22:55 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e1d152-61fe-40d4-8f7c-9777d5c22542]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:22:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ffdaa83b-1c45-4ba7-9b6b-b8c605474e57 tempest-TestInstancesWithCinderVolumes-155088745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-42e6764b-4cac-4aff-bb36-d6a78ca85695 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:22:55 devstack sudo[103366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-42e6764b-4cac-4aff-bb36-d6a78ca85695 Nov 03 13:22:55 devstack sudo[103366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:22:55 devstack sudo[103366]: pam_unix(sudo:session): session closed for user root Nov 03 13:22:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ffdaa83b-1c45-4ba7-9b6b-b8c605474e57 tempest-TestInstancesWithCinderVolumes-155088745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-42e6764b-4cac-4aff-bb36-d6a78ca85695" returned: 0 in 0.392s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:22:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ffdaa83b-1c45-4ba7-9b6b-b8c605474e57 tempest-TestInstancesWithCinderVolumes-155088745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-42e6764b-4cac-4aff-bb36-d6a78ca85695 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:22:55 devstack sudo[103371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-42e6764b-4cac-4aff-bb36-d6a78ca85695 Nov 03 13:22:55 devstack sudo[103371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:22:55 devstack sudo[103371]: pam_unix(sudo:session): session closed for user root Nov 03 13:22:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ffdaa83b-1c45-4ba7-9b6b-b8c605474e57 tempest-TestInstancesWithCinderVolumes-155088745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-42e6764b-4cac-4aff-bb36-d6a78ca85695" returned: 0 in 0.251s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:22:55 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-ffdaa83b-1c45-4ba7-9b6b-b8c605474e57 tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "cinder-quobyte-42e6764b-4cac-4aff-bb36-d6a78ca85695" released by "delete_volume" :: held 0.696s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:22:55 devstack cinder-volume[86725]: WARNING cinder.quota [None req-ffdaa83b-1c45-4ba7-9b6b-b8c605474e57 tempest-TestInstancesWithCinderVolumes-155088745 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-80963425-1258479193 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-80963425-1258479193, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:22:55 devstack cinder-volume[86725]: WARNING cinder.quota [None req-ffdaa83b-1c45-4ba7-9b6b-b8c605474e57 tempest-TestInstancesWithCinderVolumes-155088745 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-80963425-1258479193 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-80963425-1258479193, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:22:56 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-ffdaa83b-1c45-4ba7-9b6b-b8c605474e57 tempest-TestInstancesWithCinderVolumes-155088745 None] Created reservations ['16d0e2b7-9ef5-4f30-86ae-1e924b74fdd8', 'a577cab5-e87e-496a-aaf9-d9eb51b2549b', '784db081-e5ee-4b5f-b064-1e18744b5dcd', 'e32d7d63-2188-4fef-a683-e1c275310118'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:22:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ffdaa83b-1c45-4ba7-9b6b-b8c605474e57 tempest-TestInstancesWithCinderVolumes-155088745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:22:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ffdaa83b-1c45-4ba7-9b6b-b8c605474e57 tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:22:56 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ffdaa83b-1c45-4ba7-9b6b-b8c605474e57 tempest-TestInstancesWithCinderVolumes-155088745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:22:56 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ffdaa83b-1c45-4ba7-9b6b-b8c605474e57 tempest-TestInstancesWithCinderVolumes-155088745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:22:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ffdaa83b-1c45-4ba7-9b6b-b8c605474e57 tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:22:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ffdaa83b-1c45-4ba7-9b6b-b8c605474e57 tempest-TestInstancesWithCinderVolumes-155088745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:22:56 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:22:56 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:22:56 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Nov 03 13:22:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ffdaa83b-1c45-4ba7-9b6b-b8c605474e57 tempest-TestInstancesWithCinderVolumes-155088745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.279s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:22:56 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-ffdaa83b-1c45-4ba7-9b6b-b8c605474e57 tempest-TestInstancesWithCinderVolumes-155088745 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:22:56 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-ffdaa83b-1c45-4ba7-9b6b-b8c605474e57 tempest-TestInstancesWithCinderVolumes-155088745 None] Deleted volume successfully. Nov 03 13:22:56 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-ffdaa83b-1c45-4ba7-9b6b-b8c605474e57 tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "cinder-42e6764b-4cac-4aff-bb36-d6a78ca85695-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:22:58 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:22:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:22:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:22:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:22:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:22:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:22:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:22:58 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-406da7e3-5a47-4fef-b489-a2d89156830d req-4d7b9e0f-1742-4c62-bb02-67390b97a075 tempest-TestInstancesWithCinderVolumes-155088745 None] Terminate volume connection completed successfully. Nov 03 13:22:58 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-406da7e3-5a47-4fef-b489-a2d89156830d req-4d7b9e0f-1742-4c62-bb02-67390b97a075 tempest-TestInstancesWithCinderVolumes-155088745 None] Deleting attachment 2f51c7f9-5564-4130-a422-c41e4826320d. {{(pid=86725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:22:58 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:22:58 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:22:59 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Nov 03 13:22:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.283s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:22:59 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:22:59 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager._thread_info {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:22:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread count: 28 {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:22:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread info: [<_MainThread(MainThread, started 133507074375808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:23:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-87f98565-09a0-4cc6-a2b4-6a055164bd48 tempest-TestInstancesWithCinderVolumes-155088745 None] Acquiring lock "cinder-11182734-edea-4f65-b312-d143fd1571fb-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:23:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-87f98565-09a0-4cc6-a2b4-6a055164bd48 tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "cinder-11182734-edea-4f65-b312-d143fd1571fb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:23:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-87f98565-09a0-4cc6-a2b4-6a055164bd48 tempest-TestInstancesWithCinderVolumes-155088745 None] Acquiring lock "cinder-quobyte-11182734-edea-4f65-b312-d143fd1571fb" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:23:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-87f98565-09a0-4cc6-a2b4-6a055164bd48 tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "cinder-quobyte-11182734-edea-4f65-b312-d143fd1571fb" acquired by "delete_volume" :: waited 0.014s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:23:00 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18133dc-d541-487f-b4cd-b45f0021ef28]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:23:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-87f98565-09a0-4cc6-a2b4-6a055164bd48 tempest-TestInstancesWithCinderVolumes-155088745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-11182734-edea-4f65-b312-d143fd1571fb {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:23:00 devstack sudo[103417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-11182734-edea-4f65-b312-d143fd1571fb Nov 03 13:23:00 devstack sudo[103417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:23:00 devstack sudo[103417]: pam_unix(sudo:session): session closed for user root Nov 03 13:23:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-87f98565-09a0-4cc6-a2b4-6a055164bd48 tempest-TestInstancesWithCinderVolumes-155088745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-11182734-edea-4f65-b312-d143fd1571fb" returned: 0 in 0.355s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:23:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-87f98565-09a0-4cc6-a2b4-6a055164bd48 tempest-TestInstancesWithCinderVolumes-155088745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-11182734-edea-4f65-b312-d143fd1571fb {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:23:00 devstack sudo[103422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-11182734-edea-4f65-b312-d143fd1571fb Nov 03 13:23:00 devstack sudo[103422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:23:00 devstack sudo[103422]: pam_unix(sudo:session): session closed for user root Nov 03 13:23:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-87f98565-09a0-4cc6-a2b4-6a055164bd48 tempest-TestInstancesWithCinderVolumes-155088745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-11182734-edea-4f65-b312-d143fd1571fb" returned: 0 in 0.243s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:23:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-87f98565-09a0-4cc6-a2b4-6a055164bd48 tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "cinder-quobyte-11182734-edea-4f65-b312-d143fd1571fb" released by "delete_volume" :: held 0.640s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:23:00 devstack cinder-volume[86725]: WARNING cinder.quota [None req-87f98565-09a0-4cc6-a2b4-6a055164bd48 tempest-TestInstancesWithCinderVolumes-155088745 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1062596289-1904167069 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1062596289-1904167069, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:23:00 devstack cinder-volume[86725]: WARNING cinder.quota [None req-87f98565-09a0-4cc6-a2b4-6a055164bd48 tempest-TestInstancesWithCinderVolumes-155088745 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1062596289-1904167069 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1062596289-1904167069, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:23:00 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-87f98565-09a0-4cc6-a2b4-6a055164bd48 tempest-TestInstancesWithCinderVolumes-155088745 None] Created reservations ['33e70be5-9823-4dde-970d-fd9903a21d06', 'a7a4b574-d668-46fe-8797-79ea0807e29d', 'a65955fa-0af4-477a-ae90-118ac92f58d8', '9d38da2b-163f-40d7-a3ce-34b58feaea57'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:23:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-87f98565-09a0-4cc6-a2b4-6a055164bd48 tempest-TestInstancesWithCinderVolumes-155088745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:23:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-87f98565-09a0-4cc6-a2b4-6a055164bd48 tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:23:00 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-87f98565-09a0-4cc6-a2b4-6a055164bd48 tempest-TestInstancesWithCinderVolumes-155088745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:23:00 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-87f98565-09a0-4cc6-a2b4-6a055164bd48 tempest-TestInstancesWithCinderVolumes-155088745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:23:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-87f98565-09a0-4cc6-a2b4-6a055164bd48 tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:23:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-87f98565-09a0-4cc6-a2b4-6a055164bd48 tempest-TestInstancesWithCinderVolumes-155088745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:23:00 devstack sudo[103425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:23:00 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:23:01 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root Nov 03 13:23:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-87f98565-09a0-4cc6-a2b4-6a055164bd48 tempest-TestInstancesWithCinderVolumes-155088745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.245s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:23:01 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-87f98565-09a0-4cc6-a2b4-6a055164bd48 tempest-TestInstancesWithCinderVolumes-155088745 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:23:01 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-87f98565-09a0-4cc6-a2b4-6a055164bd48 tempest-TestInstancesWithCinderVolumes-155088745 None] Deleted volume successfully. Nov 03 13:23:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-87f98565-09a0-4cc6-a2b4-6a055164bd48 tempest-TestInstancesWithCinderVolumes-155088745 None] Lock "cinder-11182734-edea-4f65-b312-d143fd1571fb-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:23:10 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=30,cinder:UPDATE=27,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:23:11 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=32,cinder:UPDATE=27,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] Flow 'volume_create_manager' (c8754153-8ba4-4c2b-99b9-e1c606725199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29a36fd2-e802-46c8-8330-2cfe312c8f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29a36fd2-e802-46c8-8330-2cfe312c8f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-959982164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5920d100-8980-45ac-8409-c192d29055df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79453bb956d24f519c991822297a7938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:23:31Z,use_quota=True,user_id='2c9307d99c374c96b48ca0080678b11b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c97665a-665d-4029-a2e2-dd0d41aa75c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c97665a-665d-4029-a2e2-dd0d41aa75c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e61443-7c2d-4a57-a0d0-01b8a3f6052c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e61443-7c2d-4a57-a0d0-01b8a3f6052c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5920d100-8980-45ac-8409-c192d29055df', 'volume_name': 'volume-5920d100-8980-45ac-8409-c192d29055df', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (300cbd6a-b660-4e38-8366-16b6a71f5220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (300cbd6a-b660-4e38-8366-16b6a71f5220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (166af36b-d90c-4d62-bd54-6fe01128bad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:23:31 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] Volume 5920d100-8980-45ac-8409-c192d29055df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5920d100-8980-45ac-8409-c192d29055df', 'volume_size': 1} Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-959982164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5920d100-8980-45ac-8409-c192d29055df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79453bb956d24f519c991822297a7938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:23:31Z,use_quota=True,user_id='2c9307d99c374c96b48ca0080678b11b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] Creating volume 5920d100-8980-45ac-8409-c192d29055df {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:23:31 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5920d100-8980-45ac-8409-c192d29055df 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:23:31 devstack sudo[103441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5920d100-8980-45ac-8409-c192d29055df 1073741824 Nov 03 13:23:31 devstack sudo[103441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] Flow 'volume_create_manager' (787424ad-3bf8-4ced-8a44-36178db3e144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (440d2def-21a4-442a-ac09-2056726494ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (440d2def-21a4-442a-ac09-2056726494ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1179778208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e430be99-bebc-4459-80cf-c00872c27626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79453bb956d24f519c991822297a7938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:23:32Z,use_quota=True,user_id='2c9307d99c374c96b48ca0080678b11b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (164fd2b1-a44f-4b86-92a4-2e6dad4ed4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (164fd2b1-a44f-4b86-92a4-2e6dad4ed4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e060f00f-47c6-4fee-b0c5-3fb3a5e9f09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e060f00f-47c6-4fee-b0c5-3fb3a5e9f09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e430be99-bebc-4459-80cf-c00872c27626', 'volume_name': 'volume-e430be99-bebc-4459-80cf-c00872c27626', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82bdabb7-04ce-47cb-a573-22377360279a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82bdabb7-04ce-47cb-a573-22377360279a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c6e6c9-6be9-4d51-a63d-ae33613647c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:23:31 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] Volume e430be99-bebc-4459-80cf-c00872c27626: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e430be99-bebc-4459-80cf-c00872c27626', 'volume_size': 1} Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:23:31 devstack sudo[103441]: pam_unix(sudo:session): session closed for user root Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5920d100-8980-45ac-8409-c192d29055df 1073741824" returned: 0 in 0.474s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:23:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5920d100-8980-45ac-8409-c192d29055df {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:23:31 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5920d100-8980-45ac-8409-c192d29055df Nov 03 13:23:31 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:23:32 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Nov 03 13:23:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5920d100-8980-45ac-8409-c192d29055df" returned: 0 in 0.275s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:23:32 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:23:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:23:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.470s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:23:32 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1179778208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e430be99-bebc-4459-80cf-c00872c27626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79453bb956d24f519c991822297a7938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:23:32Z,use_quota=True,user_id='2c9307d99c374c96b48ca0080678b11b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:23:32 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] Creating volume e430be99-bebc-4459-80cf-c00872c27626 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:23:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:23:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:23:32 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:23:32 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:23:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:23:32 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:23:32 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:23:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e430be99-bebc-4459-80cf-c00872c27626 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:23:32 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (166af36b-d90c-4d62-bd54-6fe01128bad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5920d100-8980-45ac-8409-c192d29055df', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:23:32 devstack sudo[103450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e430be99-bebc-4459-80cf-c00872c27626 1073741824 Nov 03 13:23:32 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:23:32 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e92106-249f-48f0-835d-8f3a12f51ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:23:32 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] Volume volume-5920d100-8980-45ac-8409-c192d29055df (5920d100-8980-45ac-8409-c192d29055df): created successfully Nov 03 13:23:32 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e92106-249f-48f0-835d-8f3a12f51ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:23:32 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] Flow 'volume_create_manager' (c8754153-8ba4-4c2b-99b9-e1c606725199) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:23:32 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-f245c76c-96bc-4a4e-b5a5-79e71f3ed0c4 tempest-TestServerVolumeAttachmentScenario-513740851 None] Created volume successfully. Nov 03 13:23:32 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root Nov 03 13:23:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e430be99-bebc-4459-80cf-c00872c27626 1073741824" returned: 0 in 0.474s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:23:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e430be99-bebc-4459-80cf-c00872c27626 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:23:32 devstack sudo[103455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e430be99-bebc-4459-80cf-c00872c27626 Nov 03 13:23:32 devstack sudo[103455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:23:32 devstack sudo[103455]: pam_unix(sudo:session): session closed for user root Nov 03 13:23:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e430be99-bebc-4459-80cf-c00872c27626" returned: 0 in 0.258s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:23:32 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:23:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:23:32 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c6e6c9-6be9-4d51-a63d-ae33613647c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e430be99-bebc-4459-80cf-c00872c27626', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:23:32 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55292e71-19e0-4604-baf9-b091725bc841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:23:32 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] Volume volume-e430be99-bebc-4459-80cf-c00872c27626 (e430be99-bebc-4459-80cf-c00872c27626): created successfully Nov 03 13:23:32 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55292e71-19e0-4604-baf9-b091725bc841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:23:32 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] Flow 'volume_create_manager' (787424ad-3bf8-4ced-8a44-36178db3e144) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:23:33 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-833cddcb-1b9b-463b-8c60-be955148e724 tempest-TestServerVolumeAttachmentScenario-513740851 None] Created volume successfully. Nov 03 13:23:42 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=3,cinder:UPDATE=7 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:23:43 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=6,cinder:UPDATE=6,cinder:INSERT=2,cinder:DELETE=2 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:23:58 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:23:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:23:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:23:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:23:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:23:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:23:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:23:58 devstack sudo[103606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:23:58 devstack sudo[103606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:23:59 devstack sudo[103606]: pam_unix(sudo:session): session closed for user root Nov 03 13:23:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.246s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:23:59 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:23:59 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager._thread_info {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:23:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread count: 28 {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:23:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread info: [<_MainThread(MainThread, started 133507074375808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:24:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-27064e83-1123-4a08-b50c-aa07ac9c6126 req-d9cad4ee-42a7-41e7-b4ca-4477e17c3950 tempest-TestServerVolumeAttachmentScenario-513740851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:24:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-27064e83-1123-4a08-b50c-aa07ac9c6126 req-d9cad4ee-42a7-41e7-b4ca-4477e17c3950 tempest-TestServerVolumeAttachmentScenario-513740851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:24:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-27064e83-1123-4a08-b50c-aa07ac9c6126 req-d9cad4ee-42a7-41e7-b4ca-4477e17c3950 tempest-TestServerVolumeAttachmentScenario-513740851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:24:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-27064e83-1123-4a08-b50c-aa07ac9c6126 req-d9cad4ee-42a7-41e7-b4ca-4477e17c3950 tempest-TestServerVolumeAttachmentScenario-513740851 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43', 'name': 'volume-5920d100-8980-45ac-8409-c192d29055df', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dbeabdbf-7d3d-41a0-8cd8-e8c591a4cb87', 'enforce_multipath': True} {{(pid=86725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:24:02 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-27064e83-1123-4a08-b50c-aa07ac9c6126 req-d9cad4ee-42a7-41e7-b4ca-4477e17c3950 tempest-TestServerVolumeAttachmentScenario-513740851 None] attachment_update completed successfully. Nov 03 13:24:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-06b4615b-0561-4a35-a08f-632ef0e85f1b req-540dd28f-b124-4b1f-b604-f963ab2e3bba tempest-TestServerVolumeAttachmentScenario-513740851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:24:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-06b4615b-0561-4a35-a08f-632ef0e85f1b req-540dd28f-b124-4b1f-b604-f963ab2e3bba tempest-TestServerVolumeAttachmentScenario-513740851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:24:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-06b4615b-0561-4a35-a08f-632ef0e85f1b req-540dd28f-b124-4b1f-b604-f963ab2e3bba tempest-TestServerVolumeAttachmentScenario-513740851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:24:05 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-06b4615b-0561-4a35-a08f-632ef0e85f1b req-540dd28f-b124-4b1f-b604-f963ab2e3bba tempest-TestServerVolumeAttachmentScenario-513740851 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43', 'name': 'volume-e430be99-bebc-4459-80cf-c00872c27626', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dc5959b4-c776-4a70-81ab-c376d1544f53', 'enforce_multipath': True} {{(pid=86725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:24:05 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-06b4615b-0561-4a35-a08f-632ef0e85f1b req-540dd28f-b124-4b1f-b604-f963ab2e3bba tempest-TestServerVolumeAttachmentScenario-513740851 None] attachment_update completed successfully. Nov 03 13:24:07 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-08c52de9-2c5e-4186-9e5d-43d0d846a66c req-f478f36e-4f1b-42a0-b9a3-c53331a4f205 tempest-TestServerVolumeAttachmentScenario-513740851 None] Terminate volume connection completed successfully. Nov 03 13:24:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-08c52de9-2c5e-4186-9e5d-43d0d846a66c req-f478f36e-4f1b-42a0-b9a3-c53331a4f205 tempest-TestServerVolumeAttachmentScenario-513740851 None] Deleting attachment dc5959b4-c776-4a70-81ab-c376d1544f53. {{(pid=86725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:24:08 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-e5ac78ea-5057-4206-95a5-fa59ff4af552 req-d750c385-ed66-4e8d-ab1a-f5edbc495f24 tempest-TestServerVolumeAttachmentScenario-513740851 None] Terminate volume connection completed successfully. Nov 03 13:24:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-e5ac78ea-5057-4206-95a5-fa59ff4af552 req-d750c385-ed66-4e8d-ab1a-f5edbc495f24 tempest-TestServerVolumeAttachmentScenario-513740851 None] Deleting attachment dbeabdbf-7d3d-41a0-8cd8-e8c591a4cb87. {{(pid=86725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:24:13 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9740de0c-e43e-4afd-88dd-2599a65fa431 tempest-TestServerVolumeAttachmentScenario-513740851 None] Acquiring lock "cinder-e430be99-bebc-4459-80cf-c00872c27626-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:24:13 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9740de0c-e43e-4afd-88dd-2599a65fa431 tempest-TestServerVolumeAttachmentScenario-513740851 None] Lock "cinder-e430be99-bebc-4459-80cf-c00872c27626-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:24:13 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9740de0c-e43e-4afd-88dd-2599a65fa431 tempest-TestServerVolumeAttachmentScenario-513740851 None] Acquiring lock "cinder-quobyte-e430be99-bebc-4459-80cf-c00872c27626" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:24:13 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9740de0c-e43e-4afd-88dd-2599a65fa431 tempest-TestServerVolumeAttachmentScenario-513740851 None] Lock "cinder-quobyte-e430be99-bebc-4459-80cf-c00872c27626" acquired by "delete_volume" :: waited 0.015s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:24:13 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddac440-397e-429f-a4fd-f0c6f64bfce8]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:24:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9740de0c-e43e-4afd-88dd-2599a65fa431 tempest-TestServerVolumeAttachmentScenario-513740851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e430be99-bebc-4459-80cf-c00872c27626 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:24:13 devstack sudo[104105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e430be99-bebc-4459-80cf-c00872c27626 Nov 03 13:24:13 devstack sudo[104105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:24:13 devstack sudo[104105]: pam_unix(sudo:session): session closed for user root Nov 03 13:24:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9740de0c-e43e-4afd-88dd-2599a65fa431 tempest-TestServerVolumeAttachmentScenario-513740851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e430be99-bebc-4459-80cf-c00872c27626" returned: 0 in 0.357s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:24:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9740de0c-e43e-4afd-88dd-2599a65fa431 tempest-TestServerVolumeAttachmentScenario-513740851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e430be99-bebc-4459-80cf-c00872c27626 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:24:13 devstack sudo[104110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e430be99-bebc-4459-80cf-c00872c27626 Nov 03 13:24:13 devstack sudo[104110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:24:13 devstack sudo[104110]: pam_unix(sudo:session): session closed for user root Nov 03 13:24:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9740de0c-e43e-4afd-88dd-2599a65fa431 tempest-TestServerVolumeAttachmentScenario-513740851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e430be99-bebc-4459-80cf-c00872c27626" returned: 0 in 0.244s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:24:13 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9740de0c-e43e-4afd-88dd-2599a65fa431 tempest-TestServerVolumeAttachmentScenario-513740851 None] Lock "cinder-quobyte-e430be99-bebc-4459-80cf-c00872c27626" released by "delete_volume" :: held 0.641s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:24:13 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-9740de0c-e43e-4afd-88dd-2599a65fa431 tempest-TestServerVolumeAttachmentScenario-513740851 None] Created reservations ['31aa546d-cc64-40a9-a1d4-a2e12c9fa299', 'fcafd753-ff2a-4982-9ced-2705d4dd4f8a', '9d985056-d763-49fe-a733-058b1cfcff46', 'af665a7c-ac4c-41e2-852d-6af547ebdb36'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:24:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9740de0c-e43e-4afd-88dd-2599a65fa431 tempest-TestServerVolumeAttachmentScenario-513740851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:24:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9740de0c-e43e-4afd-88dd-2599a65fa431 tempest-TestServerVolumeAttachmentScenario-513740851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:24:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-9740de0c-e43e-4afd-88dd-2599a65fa431 tempest-TestServerVolumeAttachmentScenario-513740851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:24:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-9740de0c-e43e-4afd-88dd-2599a65fa431 tempest-TestServerVolumeAttachmentScenario-513740851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:24:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9740de0c-e43e-4afd-88dd-2599a65fa431 tempest-TestServerVolumeAttachmentScenario-513740851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:24:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9740de0c-e43e-4afd-88dd-2599a65fa431 tempest-TestServerVolumeAttachmentScenario-513740851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:24:13 devstack sudo[104113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:24:13 devstack sudo[104113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:24:14 devstack sudo[104113]: pam_unix(sudo:session): session closed for user root Nov 03 13:24:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9740de0c-e43e-4afd-88dd-2599a65fa431 tempest-TestServerVolumeAttachmentScenario-513740851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.239s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:24:14 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-9740de0c-e43e-4afd-88dd-2599a65fa431 tempest-TestServerVolumeAttachmentScenario-513740851 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:24:14 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-9740de0c-e43e-4afd-88dd-2599a65fa431 tempest-TestServerVolumeAttachmentScenario-513740851 None] Deleted volume successfully. Nov 03 13:24:14 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9740de0c-e43e-4afd-88dd-2599a65fa431 tempest-TestServerVolumeAttachmentScenario-513740851 None] Lock "cinder-e430be99-bebc-4459-80cf-c00872c27626-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:24:14 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3c08602b-0092-4e0a-b906-9e10ade7e6f3 tempest-TestServerVolumeAttachmentScenario-513740851 None] Acquiring lock "cinder-5920d100-8980-45ac-8409-c192d29055df-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:24:14 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3c08602b-0092-4e0a-b906-9e10ade7e6f3 tempest-TestServerVolumeAttachmentScenario-513740851 None] Lock "cinder-5920d100-8980-45ac-8409-c192d29055df-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:24:14 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3c08602b-0092-4e0a-b906-9e10ade7e6f3 tempest-TestServerVolumeAttachmentScenario-513740851 None] Acquiring lock "cinder-quobyte-5920d100-8980-45ac-8409-c192d29055df" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:24:14 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3c08602b-0092-4e0a-b906-9e10ade7e6f3 tempest-TestServerVolumeAttachmentScenario-513740851 None] Lock "cinder-quobyte-5920d100-8980-45ac-8409-c192d29055df" acquired by "delete_volume" :: waited 0.014s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:24:14 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbca18c-dbe4-433d-b82a-85396b368917]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:24:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3c08602b-0092-4e0a-b906-9e10ade7e6f3 tempest-TestServerVolumeAttachmentScenario-513740851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5920d100-8980-45ac-8409-c192d29055df {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:24:14 devstack sudo[104116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5920d100-8980-45ac-8409-c192d29055df Nov 03 13:24:14 devstack sudo[104116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:24:14 devstack sudo[104116]: pam_unix(sudo:session): session closed for user root Nov 03 13:24:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3c08602b-0092-4e0a-b906-9e10ade7e6f3 tempest-TestServerVolumeAttachmentScenario-513740851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5920d100-8980-45ac-8409-c192d29055df" returned: 0 in 0.351s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:24:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3c08602b-0092-4e0a-b906-9e10ade7e6f3 tempest-TestServerVolumeAttachmentScenario-513740851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5920d100-8980-45ac-8409-c192d29055df {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:24:14 devstack sudo[104121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5920d100-8980-45ac-8409-c192d29055df Nov 03 13:24:14 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:24:14 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root Nov 03 13:24:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3c08602b-0092-4e0a-b906-9e10ade7e6f3 tempest-TestServerVolumeAttachmentScenario-513740851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5920d100-8980-45ac-8409-c192d29055df" returned: 0 in 0.245s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:24:14 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3c08602b-0092-4e0a-b906-9e10ade7e6f3 tempest-TestServerVolumeAttachmentScenario-513740851 None] Lock "cinder-quobyte-5920d100-8980-45ac-8409-c192d29055df" released by "delete_volume" :: held 0.636s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:24:14 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-3c08602b-0092-4e0a-b906-9e10ade7e6f3 tempest-TestServerVolumeAttachmentScenario-513740851 None] Created reservations ['3240c265-ef35-4c3f-a4ac-eb461051ee64', 'c5a8d7fb-2933-4a29-90d2-d2e7da8cbf81', '93be4086-bdca-48c6-9a4a-684cdb36a0ec', '991daab2-27ae-4e7d-aebc-90b65e56c386'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:24:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3c08602b-0092-4e0a-b906-9e10ade7e6f3 tempest-TestServerVolumeAttachmentScenario-513740851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:24:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3c08602b-0092-4e0a-b906-9e10ade7e6f3 tempest-TestServerVolumeAttachmentScenario-513740851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:24:15 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3c08602b-0092-4e0a-b906-9e10ade7e6f3 tempest-TestServerVolumeAttachmentScenario-513740851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:24:15 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3c08602b-0092-4e0a-b906-9e10ade7e6f3 tempest-TestServerVolumeAttachmentScenario-513740851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:24:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3c08602b-0092-4e0a-b906-9e10ade7e6f3 tempest-TestServerVolumeAttachmentScenario-513740851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:24:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3c08602b-0092-4e0a-b906-9e10ade7e6f3 tempest-TestServerVolumeAttachmentScenario-513740851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:24:15 devstack sudo[104124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:24:15 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:24:15 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root Nov 03 13:24:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3c08602b-0092-4e0a-b906-9e10ade7e6f3 tempest-TestServerVolumeAttachmentScenario-513740851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.252s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:24:15 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3c08602b-0092-4e0a-b906-9e10ade7e6f3 tempest-TestServerVolumeAttachmentScenario-513740851 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:24:15 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-3c08602b-0092-4e0a-b906-9e10ade7e6f3 tempest-TestServerVolumeAttachmentScenario-513740851 None] Deleted volume successfully. Nov 03 13:24:15 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3c08602b-0092-4e0a-b906-9e10ade7e6f3 tempest-TestServerVolumeAttachmentScenario-513740851 None] Lock "cinder-5920d100-8980-45ac-8409-c192d29055df-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:24:25 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=23,cinder:UPDATE=20,cinder:INSERT=3 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:24:25 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=27,cinder:UPDATE=18,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:24:47 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:24:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Flow 'volume_create_manager' (1a9449f9-c20c-441e-a013-23e37c13436b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:24:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (022449ab-73a5-42c1-a5ff-c427e34eab90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:24:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (022449ab-73a5-42c1-a5ff-c427e34eab90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1399193390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=939a0e23-8ee6-49a0-bdfa-2209781fe7d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd0cbaf5214f4bdabc20c723b293e81e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:24:47Z,use_quota=True,user_id='3a5d093e8dbe4b15a90f57b500ad693b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:24:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a5c6574-5e21-45ac-8645-46784714fb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:24:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a5c6574-5e21-45ac-8645-46784714fb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:24:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07839f21-af49-4c50-beee-9f13a222af24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:24:47 devstack cinder-volume[86725]: DEBUG cinder.image.glance [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Creating Keystone auth plugin from conf {{(pid=86725) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 13:24:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07839f21-af49-4c50-beee-9f13a222af24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '939a0e23-8ee6-49a0-bdfa-2209781fe7d8', 'volume_name': 'volume-939a0e23-8ee6-49a0-bdfa-2209781fe7d8', 'volume_size': 1, 'image_id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8a9fdfe427f436894d9c81085f9b6d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'created_at': datetime.datetime(2026, 11, 3, 12, 0, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 0, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:24:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099963af-2249-4de6-b698-48d912457a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:24:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099963af-2249-4de6-b698-48d912457a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:24:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2717a434-9633-4828-ab29-153392728d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:24:47 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Volume 939a0e23-8ee6-49a0-bdfa-2209781fe7d8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-939a0e23-8ee6-49a0-bdfa-2209781fe7d8', 'volume_size': 1, 'image_id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8a9fdfe427f436894d9c81085f9b6d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'created_at': datetime.datetime(2026, 11, 3, 12, 0, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 0, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 13:24:47 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Trying to clone 939a0e23-8ee6-49a0-bdfa-2209781fe7d8 from image d23bcc2f-7dfc-45dc-b259-aec67f909b4f at location (None, [{'url': 'file:///opt/stack/data/glance/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'metadata': {}}]). {{(pid=86725) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 13:24:48 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_4nb31c7vdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86725) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 13:24:48 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Image download 20.69 MB at 20.69 MB/s Nov 03 13:24:48 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[950d2548-d7f3-45d6-b997-ad0da15144a3]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:24:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_4nb31c7vdevstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:24:48 devstack sudo[104143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_4nb31c7vdevstack@QuobyteHD Nov 03 13:24:48 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:24:48 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root Nov 03 13:24:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_4nb31c7vdevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:24:48 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Temporary image d23bcc2f-7dfc-45dc-b259-aec67f909b4f is fetched for user 3a5d093e8dbe4b15a90f57b500ad693b. {{(pid=86725) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 13:24:48 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[98eb0fdb-a9d9-4aa1-af6b-0d4a2659617e]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:24:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_4nb31c7vdevstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:24:48 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_4nb31c7vdevstack@QuobyteHD Nov 03 13:24:48 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:24:48 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Nov 03 13:24:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_4nb31c7vdevstack@QuobyteHD" returned: 0 in 0.319s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:24:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:24:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:24:48 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1399193390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=939a0e23-8ee6-49a0-bdfa-2209781fe7d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd0cbaf5214f4bdabc20c723b293e81e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:24:47Z,use_quota=True,user_id='3a5d093e8dbe4b15a90f57b500ad693b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:24:48 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Creating volume 939a0e23-8ee6-49a0-bdfa-2209781fe7d8 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:24:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:24:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:24:48 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:24:48 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:24:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:24:48 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:24:48 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:24:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-939a0e23-8ee6-49a0-bdfa-2209781fe7d8 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:24:48 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-939a0e23-8ee6-49a0-bdfa-2209781fe7d8 1073741824 Nov 03 13:24:48 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:24:49 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Nov 03 13:24:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-939a0e23-8ee6-49a0-bdfa-2209781fe7d8 1073741824" returned: 0 in 0.410s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:24:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-939a0e23-8ee6-49a0-bdfa-2209781fe7d8 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:24:49 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-939a0e23-8ee6-49a0-bdfa-2209781fe7d8 Nov 03 13:24:49 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:24:49 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Nov 03 13:24:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-939a0e23-8ee6-49a0-bdfa-2209781fe7d8" returned: 0 in 0.251s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:24:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:24:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:24:49 devstack cinder-volume[86725]: DEBUG cinder.volume.volume_utils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Attempting download of d23bcc2f-7dfc-45dc-b259-aec67f909b4f ((None, [{'url': 'file:///opt/stack/data/glance/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'metadata': {}}])) to volume 939a0e23-8ee6-49a0-bdfa-2209781fe7d8. {{(pid=86725) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 13:24:49 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba2fc05-8de3-44ab-b070-ff5526fba6ab]: (4, 'raw') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:24:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_nl6nbk8n {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:24:49 devstack sudo[104161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_nl6nbk8n Nov 03 13:24:49 devstack sudo[104161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:24:49 devstack sudo[104161]: pam_unix(sudo:session): session closed for user root Nov 03 13:24:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_nl6nbk8n" returned: 0 in 0.327s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:24:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_nl6nbk8n {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:24:50 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_nl6nbk8n Nov 03 13:24:50 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:24:50 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Nov 03 13:24:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_nl6nbk8n" returned: 1 in 0.331s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:24:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_nl6nbk8n' failed. Not Retrying. {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:24:50 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5f48d3-7fbe-4f3f-9e3d-86e3256e90aa]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:24:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_4nb31c7vdevstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:24:50 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_4nb31c7vdevstack@QuobyteHD Nov 03 13:24:50 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:24:50 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Nov 03 13:24:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_4nb31c7vdevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:24:50 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] d23bcc2f-7dfc-45dc-b259-aec67f909b4f was qcow2, converting to qcow2 {{(pid=86725) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 13:24:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_4nb31c7vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-939a0e23-8ee6-49a0-bdfa-2209781fe7d8 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:24:50 devstack sudo[104210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_4nb31c7vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-939a0e23-8ee6-49a0-bdfa-2209781fe7d8 Nov 03 13:24:50 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:24:52 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root Nov 03 13:24:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_4nb31c7vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-939a0e23-8ee6-49a0-bdfa-2209781fe7d8" returned: 0 in 1.727s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:24:52 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d23bcc2f-7dfc-45dc-b259-aec67f909b4f_4nb31c7vdevstack@QuobyteHD, size 112.00 MB, duration 1.73 sec, destination /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-939a0e23-8ee6-49a0-bdfa-2209781fe7d8 {{(pid=86725) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:24:52 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Converted 112.00 MB image at 64.82 MB/s Nov 03 13:24:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-939a0e23-8ee6-49a0-bdfa-2209781fe7d8 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:24:52 devstack sudo[104223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-939a0e23-8ee6-49a0-bdfa-2209781fe7d8 1G Nov 03 13:24:52 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:24:52 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root Nov 03 13:24:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-939a0e23-8ee6-49a0-bdfa-2209781fe7d8 1G" returned: 0 in 0.320s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:24:52 devstack cinder-volume[86725]: DEBUG cinder.volume.volume_utils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Downloaded image d23bcc2f-7dfc-45dc-b259-aec67f909b4f ((None, [{'url': 'file:///opt/stack/data/glance/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'metadata': {}}])) to volume 939a0e23-8ee6-49a0-bdfa-2209781fe7d8 successfully. {{(pid=86725) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 13:24:52 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Temporary image d23bcc2f-7dfc-45dc-b259-aec67f909b4f for user 3a5d093e8dbe4b15a90f57b500ad693b is deleted. {{(pid=86725) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 13:24:52 devstack cinder-volume[86725]: DEBUG cinder.volume.volume_utils [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Marking volume 939a0e23-8ee6-49a0-bdfa-2209781fe7d8 as bootable. {{(pid=86725) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 13:24:52 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Copying metadata from image d23bcc2f-7dfc-45dc-b259-aec67f909b4f to 939a0e23-8ee6-49a0-bdfa-2209781fe7d8. {{(pid=86725) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 13:24:52 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Creating volume glance metadata for volume 939a0e23-8ee6-49a0-bdfa-2209781fe7d8 backed by image d23bcc2f-7dfc-45dc-b259-aec67f909b4f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86725) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 13:24:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2717a434-9633-4828-ab29-153392728d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-939a0e23-8ee6-49a0-bdfa-2209781fe7d8', 'volume_size': 1, 'image_id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8a9fdfe427f436894d9c81085f9b6d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd23bcc2f-7dfc-45dc-b259-aec67f909b4f', 'created_at': datetime.datetime(2026, 11, 3, 12, 0, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 0, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d23bcc2f-7dfc-45dc-b259-aec67f909b4f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:24:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36db890-b488-4df6-a361-d132a5607012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:24:52 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Volume volume-939a0e23-8ee6-49a0-bdfa-2209781fe7d8 (939a0e23-8ee6-49a0-bdfa-2209781fe7d8): created successfully Nov 03 13:24:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36db890-b488-4df6-a361-d132a5607012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:24:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Flow 'volume_create_manager' (1a9449f9-c20c-441e-a013-23e37c13436b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:24:52 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-58182343-f4cc-40c3-8bbb-fd9f2bea8cb6 tempest-TestShelveInstance-1835227050 None] Created volume successfully. Nov 03 13:24:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-aa516de5-56be-402f-8499-6f2f91e9dea2 req-d9718b3e-b416-41c3-8657-05f7a995bc15 tempest-TestShelveInstance-1835227050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:24:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-aa516de5-56be-402f-8499-6f2f91e9dea2 req-d9718b3e-b416-41c3-8657-05f7a995bc15 tempest-TestShelveInstance-1835227050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:24:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-aa516de5-56be-402f-8499-6f2f91e9dea2 req-d9718b3e-b416-41c3-8657-05f7a995bc15 tempest-TestShelveInstance-1835227050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:24:55 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-aa516de5-56be-402f-8499-6f2f91e9dea2 req-d9718b3e-b416-41c3-8657-05f7a995bc15 tempest-TestShelveInstance-1835227050 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43', 'name': 'volume-939a0e23-8ee6-49a0-bdfa-2209781fe7d8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dc4345e9-8d3f-4013-9808-4c68e7452305', 'enforce_multipath': True} {{(pid=86725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:24:56 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-aa516de5-56be-402f-8499-6f2f91e9dea2 req-d9718b3e-b416-41c3-8657-05f7a995bc15 tempest-TestShelveInstance-1835227050 None] attachment_update completed successfully. Nov 03 13:24:58 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:24:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:24:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:24:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:24:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:24:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:24:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:24:58 devstack sudo[104713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:24:58 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:24:59 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root Nov 03 13:24:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.305s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:24:59 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:24:59 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager._thread_info {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:24:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread count: 28 {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:24:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread info: [<_MainThread(MainThread, started 133507074375808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:25:05 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=16,cinder:INSERT=10,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:25:06 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:UPDATE=6,cinder:SELECT=16,cinder:INSERT=4 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:25:25 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-604523a1-1410-43ac-8a7a-eb57e12f160b req-97c3f065-8c8d-4418-9e4a-05d8c2d6376d tempest-TestShelveInstance-1835227050 None] Terminate volume connection completed successfully. Nov 03 13:25:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-604523a1-1410-43ac-8a7a-eb57e12f160b req-97c3f065-8c8d-4418-9e4a-05d8c2d6376d tempest-TestShelveInstance-1835227050 None] Deleting attachment dc4345e9-8d3f-4013-9808-4c68e7452305. {{(pid=86725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:25:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-c39c69c9-0952-4801-aeec-225d72b5b58f req-c2882702-cb10-4edf-add1-48efabfbaf8d tempest-TestShelveInstance-1835227050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:25:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-c39c69c9-0952-4801-aeec-225d72b5b58f req-c2882702-cb10-4edf-add1-48efabfbaf8d tempest-TestShelveInstance-1835227050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:25:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-c39c69c9-0952-4801-aeec-225d72b5b58f req-c2882702-cb10-4edf-add1-48efabfbaf8d tempest-TestShelveInstance-1835227050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:25:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-c39c69c9-0952-4801-aeec-225d72b5b58f req-c2882702-cb10-4edf-add1-48efabfbaf8d tempest-TestShelveInstance-1835227050 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43', 'name': 'volume-939a0e23-8ee6-49a0-bdfa-2209781fe7d8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2db284a5-6091-428f-85cc-7245cd3b6fdd', 'enforce_multipath': True} {{(pid=86725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:25:27 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-c39c69c9-0952-4801-aeec-225d72b5b58f req-c2882702-cb10-4edf-add1-48efabfbaf8d tempest-TestShelveInstance-1835227050 None] attachment_update completed successfully. Nov 03 13:25:37 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:25:37 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:25:58 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:25:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:25:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:25:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:25:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:25:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:25:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:25:58 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:25:58 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:25:59 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Nov 03 13:25:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.251s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:25:59 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:25:59 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager._thread_info {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:25:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread count: 28 {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:25:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread info: [<_MainThread(MainThread, started 133507074375808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:26:10 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-58f20b2b-4e53-434a-977c-755dce3b501e req-1bddcaf6-7e2c-4e52-bc0c-43692fd4a121 tempest-TestShelveInstance-1835227050 None] Terminate volume connection completed successfully. Nov 03 13:26:10 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [req-58f20b2b-4e53-434a-977c-755dce3b501e req-1bddcaf6-7e2c-4e52-bc0c-43692fd4a121 tempest-TestShelveInstance-1835227050 None] Deleting attachment 2db284a5-6091-428f-85cc-7245cd3b6fdd. {{(pid=86725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:26:10 devstack cinder-volume[86725]: DEBUG cinder.coordination [req-58f20b2b-4e53-434a-977c-755dce3b501e req-33d31270-1e3d-4e88-b29c-05d3499b2bdb tempest-TestShelveInstance-1835227050 None] Acquiring lock "cinder-939a0e23-8ee6-49a0-bdfa-2209781fe7d8-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:26:10 devstack cinder-volume[86725]: DEBUG cinder.coordination [req-58f20b2b-4e53-434a-977c-755dce3b501e req-33d31270-1e3d-4e88-b29c-05d3499b2bdb tempest-TestShelveInstance-1835227050 None] Lock "cinder-939a0e23-8ee6-49a0-bdfa-2209781fe7d8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:26:10 devstack cinder-volume[86725]: DEBUG cinder.coordination [req-58f20b2b-4e53-434a-977c-755dce3b501e req-33d31270-1e3d-4e88-b29c-05d3499b2bdb tempest-TestShelveInstance-1835227050 None] Acquiring lock "cinder-quobyte-939a0e23-8ee6-49a0-bdfa-2209781fe7d8" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:26:10 devstack cinder-volume[86725]: DEBUG cinder.coordination [req-58f20b2b-4e53-434a-977c-755dce3b501e req-33d31270-1e3d-4e88-b29c-05d3499b2bdb tempest-TestShelveInstance-1835227050 None] Lock "cinder-quobyte-939a0e23-8ee6-49a0-bdfa-2209781fe7d8" acquired by "delete_volume" :: waited 0.017s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:26:10 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6f528b-1511-4597-8f78-51a31efba765]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:26:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-58f20b2b-4e53-434a-977c-755dce3b501e req-33d31270-1e3d-4e88-b29c-05d3499b2bdb tempest-TestShelveInstance-1835227050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-939a0e23-8ee6-49a0-bdfa-2209781fe7d8 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:26:11 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-939a0e23-8ee6-49a0-bdfa-2209781fe7d8 Nov 03 13:26:11 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:26:11 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Nov 03 13:26:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-58f20b2b-4e53-434a-977c-755dce3b501e req-33d31270-1e3d-4e88-b29c-05d3499b2bdb tempest-TestShelveInstance-1835227050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-939a0e23-8ee6-49a0-bdfa-2209781fe7d8" returned: 0 in 0.385s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:26:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-58f20b2b-4e53-434a-977c-755dce3b501e req-33d31270-1e3d-4e88-b29c-05d3499b2bdb tempest-TestShelveInstance-1835227050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-939a0e23-8ee6-49a0-bdfa-2209781fe7d8 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:26:11 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-939a0e23-8ee6-49a0-bdfa-2209781fe7d8 Nov 03 13:26:11 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:26:11 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Nov 03 13:26:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-58f20b2b-4e53-434a-977c-755dce3b501e req-33d31270-1e3d-4e88-b29c-05d3499b2bdb tempest-TestShelveInstance-1835227050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-939a0e23-8ee6-49a0-bdfa-2209781fe7d8" returned: 0 in 0.257s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:26:11 devstack cinder-volume[86725]: DEBUG cinder.coordination [req-58f20b2b-4e53-434a-977c-755dce3b501e req-33d31270-1e3d-4e88-b29c-05d3499b2bdb tempest-TestShelveInstance-1835227050 None] Lock "cinder-quobyte-939a0e23-8ee6-49a0-bdfa-2209781fe7d8" released by "delete_volume" :: held 0.700s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:26:11 devstack cinder-volume[86725]: DEBUG cinder.quota [req-58f20b2b-4e53-434a-977c-755dce3b501e req-33d31270-1e3d-4e88-b29c-05d3499b2bdb tempest-TestShelveInstance-1835227050 None] Created reservations ['28928130-dacc-40c1-9fbf-1600be0ccb97', '8b36f027-1d97-4f10-9d5f-5b6a7be9b2c2', '76267a8e-b3c8-4a74-a2e0-4e49495369a5', 'cf32fc7f-a8fd-4285-8d76-6f582e9556f5'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:26:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-58f20b2b-4e53-434a-977c-755dce3b501e req-33d31270-1e3d-4e88-b29c-05d3499b2bdb tempest-TestShelveInstance-1835227050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:26:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-58f20b2b-4e53-434a-977c-755dce3b501e req-33d31270-1e3d-4e88-b29c-05d3499b2bdb tempest-TestShelveInstance-1835227050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:26:11 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [req-58f20b2b-4e53-434a-977c-755dce3b501e req-33d31270-1e3d-4e88-b29c-05d3499b2bdb tempest-TestShelveInstance-1835227050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:26:11 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [req-58f20b2b-4e53-434a-977c-755dce3b501e req-33d31270-1e3d-4e88-b29c-05d3499b2bdb tempest-TestShelveInstance-1835227050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:26:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [req-58f20b2b-4e53-434a-977c-755dce3b501e req-33d31270-1e3d-4e88-b29c-05d3499b2bdb tempest-TestShelveInstance-1835227050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:26:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-58f20b2b-4e53-434a-977c-755dce3b501e req-33d31270-1e3d-4e88-b29c-05d3499b2bdb tempest-TestShelveInstance-1835227050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:26:11 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:26:11 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:26:12 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Nov 03 13:26:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [req-58f20b2b-4e53-434a-977c-755dce3b501e req-33d31270-1e3d-4e88-b29c-05d3499b2bdb tempest-TestShelveInstance-1835227050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.255s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:26:12 devstack cinder-volume[86725]: DEBUG cinder.manager [req-58f20b2b-4e53-434a-977c-755dce3b501e req-33d31270-1e3d-4e88-b29c-05d3499b2bdb tempest-TestShelveInstance-1835227050 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:26:12 devstack cinder-volume[86725]: INFO cinder.volume.manager [req-58f20b2b-4e53-434a-977c-755dce3b501e req-33d31270-1e3d-4e88-b29c-05d3499b2bdb tempest-TestShelveInstance-1835227050 None] Deleted volume successfully. Nov 03 13:26:12 devstack cinder-volume[86725]: DEBUG cinder.coordination [req-58f20b2b-4e53-434a-977c-755dce3b501e req-33d31270-1e3d-4e88-b29c-05d3499b2bdb tempest-TestShelveInstance-1835227050 None] Lock "cinder-939a0e23-8ee6-49a0-bdfa-2209781fe7d8-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:26:21 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:26:22 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:26:24 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:26:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Flow 'volume_create_manager' (c5b040b0-efc3-4f67-87f4-3a2024efcf1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:26:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (116ce911-6245-4aa1-a49a-132252856c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (116ce911-6245-4aa1-a49a-132252856c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1309445120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc9b9288-cd30-4af5-91ab-cf63015891ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb10d705f274fc4bdf160d08ee9cf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:26:24Z,use_quota=True,user_id='e2a46777ae1a441dbbaeb08131db8801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (201cd3cf-9d4a-4488-bf5b-af3262465bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (201cd3cf-9d4a-4488-bf5b-af3262465bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f51d37e6-02dd-4bff-aa2b-de827328967d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f51d37e6-02dd-4bff-aa2b-de827328967d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc9b9288-cd30-4af5-91ab-cf63015891ea', 'volume_name': 'volume-dc9b9288-cd30-4af5-91ab-cf63015891ea', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0b49e1f-9a3c-4ffa-b969-ecccbbe1bcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0b49e1f-9a3c-4ffa-b969-ecccbbe1bcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08773967-8481-46ca-ae1e-f05207dd3ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:24 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Volume dc9b9288-cd30-4af5-91ab-cf63015891ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc9b9288-cd30-4af5-91ab-cf63015891ea', 'volume_size': 1} Nov 03 13:26:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:26:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:26:24 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1309445120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc9b9288-cd30-4af5-91ab-cf63015891ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb10d705f274fc4bdf160d08ee9cf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:26:24Z,use_quota=True,user_id='e2a46777ae1a441dbbaeb08131db8801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:26:24 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Creating volume dc9b9288-cd30-4af5-91ab-cf63015891ea {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:26:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:26:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:26:24 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:26:24 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:26:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:26:24 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:26:24 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:26:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-dc9b9288-cd30-4af5-91ab-cf63015891ea 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:26:24 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-dc9b9288-cd30-4af5-91ab-cf63015891ea 1073741824 Nov 03 13:26:24 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:26:24 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Nov 03 13:26:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-dc9b9288-cd30-4af5-91ab-cf63015891ea 1073741824" returned: 0 in 0.410s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:26:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-dc9b9288-cd30-4af5-91ab-cf63015891ea {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:26:24 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-dc9b9288-cd30-4af5-91ab-cf63015891ea Nov 03 13:26:24 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:26:24 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Nov 03 13:26:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-dc9b9288-cd30-4af5-91ab-cf63015891ea" returned: 0 in 0.241s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:26:24 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:26:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:26:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08773967-8481-46ca-ae1e-f05207dd3ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc9b9288-cd30-4af5-91ab-cf63015891ea', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb49c4a-e569-4d4e-b6ca-d548908997e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:24 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Volume volume-dc9b9288-cd30-4af5-91ab-cf63015891ea (dc9b9288-cd30-4af5-91ab-cf63015891ea): created successfully Nov 03 13:26:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb49c4a-e569-4d4e-b6ca-d548908997e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Flow 'volume_create_manager' (c5b040b0-efc3-4f67-87f4-3a2024efcf1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:26:25 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-072f383e-2cf8-4939-a47d-a73bb03cf04f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Created volume successfully. Nov 03 13:26:25 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:26:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Flow 'volume_create_manager' (a1993ff1-ed15-4bad-897b-6383bea6497e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:26:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e125d567-0723-41ee-86b7-cd91844221ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e125d567-0723-41ee-86b7-cd91844221ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1971421521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=882aa3fc-b327-4074-b924-cd726650e4ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb10d705f274fc4bdf160d08ee9cf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:26:26Z,use_quota=True,user_id='e2a46777ae1a441dbbaeb08131db8801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7336059-1dc2-4c47-b20c-fd87841f4ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7336059-1dc2-4c47-b20c-fd87841f4ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92984238-22e0-4644-aa13-f9b8ea6f8068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92984238-22e0-4644-aa13-f9b8ea6f8068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '882aa3fc-b327-4074-b924-cd726650e4ff', 'volume_name': 'volume-882aa3fc-b327-4074-b924-cd726650e4ff', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6efe17a5-daa0-4b41-a883-08e7f35777dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6efe17a5-daa0-4b41-a883-08e7f35777dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f54cbf-1f3c-4213-a02e-1ba03e2c5204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:25 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Volume 882aa3fc-b327-4074-b924-cd726650e4ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-882aa3fc-b327-4074-b924-cd726650e4ff', 'volume_size': 1} Nov 03 13:26:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:26:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:26:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1971421521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=882aa3fc-b327-4074-b924-cd726650e4ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb10d705f274fc4bdf160d08ee9cf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:26:26Z,use_quota=True,user_id='e2a46777ae1a441dbbaeb08131db8801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:26:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Creating volume 882aa3fc-b327-4074-b924-cd726650e4ff {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:26:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:26:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:26:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:26:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:26:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:26:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:26:25 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:26:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-882aa3fc-b327-4074-b924-cd726650e4ff 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:26:25 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-882aa3fc-b327-4074-b924-cd726650e4ff 1073741824 Nov 03 13:26:25 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:26:25 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:26:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Flow 'volume_create_manager' (eef147c5-bede-4fd7-911d-7dbaeac3692d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:26:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a200d391-56b0-4464-8495-c1931c7a54b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a200d391-56b0-4464-8495-c1931c7a54b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1866944735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca4ee3ac-01b0-4026-8849-332065687782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb10d705f274fc4bdf160d08ee9cf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:26:26Z,use_quota=True,user_id='e2a46777ae1a441dbbaeb08131db8801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a309452-2e6a-47b6-aa85-7d18efe9b2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a309452-2e6a-47b6-aa85-7d18efe9b2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b5dfc03-b597-4873-a927-277e3aa21cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b5dfc03-b597-4873-a927-277e3aa21cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca4ee3ac-01b0-4026-8849-332065687782', 'volume_name': 'volume-ca4ee3ac-01b0-4026-8849-332065687782', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe995f41-fa12-4a2a-a454-15406925e9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe995f41-fa12-4a2a-a454-15406925e9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a4d867-e674-4c5b-aa35-bcc99b80dc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:26 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Volume ca4ee3ac-01b0-4026-8849-332065687782: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca4ee3ac-01b0-4026-8849-332065687782', 'volume_size': 1} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:26:26 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-882aa3fc-b327-4074-b924-cd726650e4ff 1073741824" returned: 0 in 0.489s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-882aa3fc-b327-4074-b924-cd726650e4ff {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:26:26 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-882aa3fc-b327-4074-b924-cd726650e4ff Nov 03 13:26:26 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Flow 'volume_create_manager' (67df2d99-aaff-48e9-b4c9-4d3d81e01a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (865dbbcc-c3e0-4320-9eb2-c2169a727fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (865dbbcc-c3e0-4320-9eb2-c2169a727fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1526184764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db3d191c-70b7-43ed-8651-850e8ff420ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb10d705f274fc4bdf160d08ee9cf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:26:26Z,use_quota=True,user_id='e2a46777ae1a441dbbaeb08131db8801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e3a9bf8-d3ac-4ffb-8313-5b66712be6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e3a9bf8-d3ac-4ffb-8313-5b66712be6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d589d36f-61a5-4245-aa54-53283a80ef4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d589d36f-61a5-4245-aa54-53283a80ef4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db3d191c-70b7-43ed-8651-850e8ff420ae', 'volume_name': 'volume-db3d191c-70b7-43ed-8651-850e8ff420ae', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2264ede-8ae7-44da-b089-aa7a47487a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2264ede-8ae7-44da-b089-aa7a47487a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (390ebda8-b05e-486c-a3da-bf1b2c78dce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:26 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Volume db3d191c-70b7-43ed-8651-850e8ff420ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db3d191c-70b7-43ed-8651-850e8ff420ae', 'volume_size': 1} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:26:26 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-882aa3fc-b327-4074-b924-cd726650e4ff" returned: 0 in 0.262s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.440s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1866944735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca4ee3ac-01b0-4026-8849-332065687782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb10d705f274fc4bdf160d08ee9cf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:26:26Z,use_quota=True,user_id='e2a46777ae1a441dbbaeb08131db8801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Creating volume ca4ee3ac-01b0-4026-8849-332065687782 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:26:26 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ca4ee3ac-01b0-4026-8849-332065687782 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:26:26 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ca4ee3ac-01b0-4026-8849-332065687782 1073741824 Nov 03 13:26:26 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f54cbf-1f3c-4213-a02e-1ba03e2c5204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-882aa3fc-b327-4074-b924-cd726650e4ff', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05426d73-bd71-4dfe-84cc-0145057e20fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:26 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Volume volume-882aa3fc-b327-4074-b924-cd726650e4ff (882aa3fc-b327-4074-b924-cd726650e4ff): created successfully Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05426d73-bd71-4dfe-84cc-0145057e20fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Flow 'volume_create_manager' (a1993ff1-ed15-4bad-897b-6383bea6497e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:26:26 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-5f0d579c-8e10-48de-939a-4095872cbd36 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Created volume successfully. Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Flow 'volume_create_manager' (a5206440-e0e8-4666-b36f-2d6b6568d061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee7c66b7-9ba9-4e1e-a51f-6b2e12615e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee7c66b7-9ba9-4e1e-a51f-6b2e12615e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-842790215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fef8598-2a95-40b1-9cc5-1b855a15de9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb10d705f274fc4bdf160d08ee9cf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:26:27Z,use_quota=True,user_id='e2a46777ae1a441dbbaeb08131db8801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c305b803-77d6-4288-8ae6-0dbd240cdefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c305b803-77d6-4288-8ae6-0dbd240cdefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20776ea6-343b-4071-b870-2dbc79b47b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20776ea6-343b-4071-b870-2dbc79b47b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fef8598-2a95-40b1-9cc5-1b855a15de9b', 'volume_name': 'volume-5fef8598-2a95-40b1-9cc5-1b855a15de9b', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e0295d-9363-4453-9286-984975b68e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e0295d-9363-4453-9286-984975b68e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a92d2edf-7d9e-4125-b018-8c4f531a2641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:26 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Volume 5fef8598-2a95-40b1-9cc5-1b855a15de9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fef8598-2a95-40b1-9cc5-1b855a15de9b', 'volume_size': 1} Nov 03 13:26:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:26:27 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Nov 03 13:26:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ca4ee3ac-01b0-4026-8849-332065687782 1073741824" returned: 0 in 0.518s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:26:27 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:26:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Flow 'volume_create_manager' (f1a407f3-afce-45ef-8a4c-74215ba1c819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:26:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a75292-2433-4a1a-9bc1-ba84390ba291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a75292-2433-4a1a-9bc1-ba84390ba291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1481356224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20dd1499-b433-4258-a272-b9e8010a1be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb10d705f274fc4bdf160d08ee9cf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:26:27Z,use_quota=True,user_id='e2a46777ae1a441dbbaeb08131db8801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f646fe9-f5a2-408c-9d74-bbbd759513e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f646fe9-f5a2-408c-9d74-bbbd759513e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc826d62-b084-4144-ba23-94af1d3a5a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc826d62-b084-4144-ba23-94af1d3a5a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20dd1499-b433-4258-a272-b9e8010a1be5', 'volume_name': 'volume-20dd1499-b433-4258-a272-b9e8010a1be5', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27270c27-50fb-4f0a-97be-b8e815833daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27270c27-50fb-4f0a-97be-b8e815833daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fa06033-151d-455f-8695-9a827bdc5e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:27 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Volume 20dd1499-b433-4258-a272-b9e8010a1be5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20dd1499-b433-4258-a272-b9e8010a1be5', 'volume_size': 1} Nov 03 13:26:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:26:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ca4ee3ac-01b0-4026-8849-332065687782 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:26:27 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ca4ee3ac-01b0-4026-8849-332065687782 Nov 03 13:26:27 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:26:27 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Nov 03 13:26:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ca4ee3ac-01b0-4026-8849-332065687782" returned: 0 in 0.251s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:26:27 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:26:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:26:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.963s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:26:27 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1526184764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db3d191c-70b7-43ed-8651-850e8ff420ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb10d705f274fc4bdf160d08ee9cf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:26:26Z,use_quota=True,user_id='e2a46777ae1a441dbbaeb08131db8801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:26:27 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Creating volume db3d191c-70b7-43ed-8651-850e8ff420ae {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:26:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:26:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:26:27 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:26:27 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:26:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:26:27 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:26:27 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:26:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db3d191c-70b7-43ed-8651-850e8ff420ae 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:26:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a4d867-e674-4c5b-aa35-bcc99b80dc98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca4ee3ac-01b0-4026-8849-332065687782', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5dd635f-b628-4b79-8366-1aff4c61f311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:27 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db3d191c-70b7-43ed-8651-850e8ff420ae 1073741824 Nov 03 13:26:27 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:26:27 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Volume volume-ca4ee3ac-01b0-4026-8849-332065687782 (ca4ee3ac-01b0-4026-8849-332065687782): created successfully Nov 03 13:26:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5dd635f-b628-4b79-8366-1aff4c61f311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Flow 'volume_create_manager' (eef147c5-bede-4fd7-911d-7dbaeac3692d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:26:27 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-9f028991-a9af-44c8-a4a6-a881fc210a24 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Created volume successfully. Nov 03 13:26:27 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Nov 03 13:26:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db3d191c-70b7-43ed-8651-850e8ff420ae 1073741824" returned: 0 in 0.429s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:26:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db3d191c-70b7-43ed-8651-850e8ff420ae {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:26:27 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db3d191c-70b7-43ed-8651-850e8ff420ae Nov 03 13:26:27 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:26:28 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db3d191c-70b7-43ed-8651-850e8ff420ae" returned: 0 in 0.247s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.356s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-842790215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fef8598-2a95-40b1-9cc5-1b855a15de9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb10d705f274fc4bdf160d08ee9cf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:26:27Z,use_quota=True,user_id='e2a46777ae1a441dbbaeb08131db8801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Creating volume 5fef8598-2a95-40b1-9cc5-1b855a15de9b {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:26:28 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5fef8598-2a95-40b1-9cc5-1b855a15de9b 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (390ebda8-b05e-486c-a3da-bf1b2c78dce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db3d191c-70b7-43ed-8651-850e8ff420ae', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69eb7f94-414b-4203-b40a-393c29d1a567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:28 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5fef8598-2a95-40b1-9cc5-1b855a15de9b 1073741824 Nov 03 13:26:28 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:26:28 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Volume volume-db3d191c-70b7-43ed-8651-850e8ff420ae (db3d191c-70b7-43ed-8651-850e8ff420ae): created successfully Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69eb7f94-414b-4203-b40a-393c29d1a567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Flow 'volume_create_manager' (67df2d99-aaff-48e9-b4c9-4d3d81e01a96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:26:28 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-945e02dc-9c66-47be-b198-ee265838b74f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Created volume successfully. Nov 03 13:26:28 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5fef8598-2a95-40b1-9cc5-1b855a15de9b 1073741824" returned: 0 in 0.433s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5fef8598-2a95-40b1-9cc5-1b855a15de9b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:26:28 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5fef8598-2a95-40b1-9cc5-1b855a15de9b Nov 03 13:26:28 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:26:28 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5fef8598-2a95-40b1-9cc5-1b855a15de9b" returned: 0 in 0.245s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.706s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1481356224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20dd1499-b433-4258-a272-b9e8010a1be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb10d705f274fc4bdf160d08ee9cf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:26:27Z,use_quota=True,user_id='e2a46777ae1a441dbbaeb08131db8801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Creating volume 20dd1499-b433-4258-a272-b9e8010a1be5 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:26:28 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-20dd1499-b433-4258-a272-b9e8010a1be5 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a92d2edf-7d9e-4125-b018-8c4f531a2641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fef8598-2a95-40b1-9cc5-1b855a15de9b', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:28 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-20dd1499-b433-4258-a272-b9e8010a1be5 1073741824 Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6adbf607-ba1c-49f0-8bd9-d125f7fdc83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:28 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:26:28 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Volume volume-5fef8598-2a95-40b1-9cc5-1b855a15de9b (5fef8598-2a95-40b1-9cc5-1b855a15de9b): created successfully Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6adbf607-ba1c-49f0-8bd9-d125f7fdc83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Flow 'volume_create_manager' (a5206440-e0e8-4666-b36f-2d6b6568d061) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:26:28 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-c673d74b-a677-4160-9ceb-879aff1dc915 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Created volume successfully. Nov 03 13:26:29 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Nov 03 13:26:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-20dd1499-b433-4258-a272-b9e8010a1be5 1073741824" returned: 0 in 0.413s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:26:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-20dd1499-b433-4258-a272-b9e8010a1be5 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:26:29 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-20dd1499-b433-4258-a272-b9e8010a1be5 Nov 03 13:26:29 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:26:29 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Nov 03 13:26:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-20dd1499-b433-4258-a272-b9e8010a1be5" returned: 0 in 0.236s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:26:29 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:26:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:26:29 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fa06033-151d-455f-8695-9a827bdc5e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20dd1499-b433-4258-a272-b9e8010a1be5', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:29 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14faad49-a533-46a9-aa3f-875ff4b87eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:26:29 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Volume volume-20dd1499-b433-4258-a272-b9e8010a1be5 (20dd1499-b433-4258-a272-b9e8010a1be5): created successfully Nov 03 13:26:29 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14faad49-a533-46a9-aa3f-875ff4b87eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:26:29 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Flow 'volume_create_manager' (f1a407f3-afce-45ef-8a4c-74215ba1c819) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:26:29 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-0d329d3e-1b3d-4dcd-823a-ac7d7e959c8a tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Created volume successfully. Nov 03 13:26:30 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-33cc6e39-1917-4e58-a40f-3d5c09ba09aa tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Acquiring lock "cinder-20dd1499-b433-4258-a272-b9e8010a1be5-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:26:30 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-33cc6e39-1917-4e58-a40f-3d5c09ba09aa tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "cinder-20dd1499-b433-4258-a272-b9e8010a1be5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:26:30 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-33cc6e39-1917-4e58-a40f-3d5c09ba09aa tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Acquiring lock "cinder-quobyte-20dd1499-b433-4258-a272-b9e8010a1be5" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:26:30 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-33cc6e39-1917-4e58-a40f-3d5c09ba09aa tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "cinder-quobyte-20dd1499-b433-4258-a272-b9e8010a1be5" acquired by "delete_volume" :: waited 0.016s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:26:30 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8e6ceb-735b-447c-82d3-3a9a4a10447b]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:26:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-33cc6e39-1917-4e58-a40f-3d5c09ba09aa tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-20dd1499-b433-4258-a272-b9e8010a1be5 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:26:30 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-20dd1499-b433-4258-a272-b9e8010a1be5 Nov 03 13:26:30 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:26:30 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Nov 03 13:26:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-33cc6e39-1917-4e58-a40f-3d5c09ba09aa tempest-CreateVolumesFromSourceVolumeTest-800392521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-20dd1499-b433-4258-a272-b9e8010a1be5" returned: 0 in 0.353s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:26:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-33cc6e39-1917-4e58-a40f-3d5c09ba09aa tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-20dd1499-b433-4258-a272-b9e8010a1be5 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:26:30 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-20dd1499-b433-4258-a272-b9e8010a1be5 Nov 03 13:26:30 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:26:31 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Nov 03 13:26:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-33cc6e39-1917-4e58-a40f-3d5c09ba09aa tempest-CreateVolumesFromSourceVolumeTest-800392521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-20dd1499-b433-4258-a272-b9e8010a1be5" returned: 0 in 0.247s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:26:31 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-33cc6e39-1917-4e58-a40f-3d5c09ba09aa tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "cinder-quobyte-20dd1499-b433-4258-a272-b9e8010a1be5" released by "delete_volume" :: held 0.640s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:26:31 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-33cc6e39-1917-4e58-a40f-3d5c09ba09aa tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Created reservations ['2ff4104a-e90a-493c-963b-78475f29f439', '7e6fa37a-b7cc-4f9f-b07c-1a09999066fe', '0bf0258f-2de5-4f63-b75e-b259d56bd3d2', '2ccf8636-f9fb-489e-905c-2e44343fd22a'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:26:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-33cc6e39-1917-4e58-a40f-3d5c09ba09aa tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:26:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-33cc6e39-1917-4e58-a40f-3d5c09ba09aa tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:26:31 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-33cc6e39-1917-4e58-a40f-3d5c09ba09aa tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:26:31 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-33cc6e39-1917-4e58-a40f-3d5c09ba09aa tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:26:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-33cc6e39-1917-4e58-a40f-3d5c09ba09aa tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:26:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-33cc6e39-1917-4e58-a40f-3d5c09ba09aa tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:26:31 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:26:31 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:26:31 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Nov 03 13:26:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-33cc6e39-1917-4e58-a40f-3d5c09ba09aa tempest-CreateVolumesFromSourceVolumeTest-800392521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.245s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:26:31 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-33cc6e39-1917-4e58-a40f-3d5c09ba09aa tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:26:31 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-33cc6e39-1917-4e58-a40f-3d5c09ba09aa tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Deleted volume successfully. Nov 03 13:26:31 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-33cc6e39-1917-4e58-a40f-3d5c09ba09aa tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "cinder-20dd1499-b433-4258-a272-b9e8010a1be5-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:26:31 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-58a368c3-363b-47ea-a6d6-7c10420f2434 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Acquiring lock "cinder-5fef8598-2a95-40b1-9cc5-1b855a15de9b-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:26:31 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-58a368c3-363b-47ea-a6d6-7c10420f2434 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "cinder-5fef8598-2a95-40b1-9cc5-1b855a15de9b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:26:31 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-58a368c3-363b-47ea-a6d6-7c10420f2434 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Acquiring lock "cinder-quobyte-5fef8598-2a95-40b1-9cc5-1b855a15de9b" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:26:31 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-58a368c3-363b-47ea-a6d6-7c10420f2434 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "cinder-quobyte-5fef8598-2a95-40b1-9cc5-1b855a15de9b" acquired by "delete_volume" :: waited 0.017s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:26:31 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c217f6-8086-48cd-b02e-42a7a72c8be8]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:26:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-58a368c3-363b-47ea-a6d6-7c10420f2434 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5fef8598-2a95-40b1-9cc5-1b855a15de9b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:26:31 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5fef8598-2a95-40b1-9cc5-1b855a15de9b Nov 03 13:26:31 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:26:32 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Nov 03 13:26:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-58a368c3-363b-47ea-a6d6-7c10420f2434 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5fef8598-2a95-40b1-9cc5-1b855a15de9b" returned: 0 in 0.350s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:26:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-58a368c3-363b-47ea-a6d6-7c10420f2434 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5fef8598-2a95-40b1-9cc5-1b855a15de9b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:26:32 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5fef8598-2a95-40b1-9cc5-1b855a15de9b Nov 03 13:26:32 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:26:32 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Nov 03 13:26:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-58a368c3-363b-47ea-a6d6-7c10420f2434 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-5fef8598-2a95-40b1-9cc5-1b855a15de9b" returned: 0 in 0.237s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:26:32 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-58a368c3-363b-47ea-a6d6-7c10420f2434 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "cinder-quobyte-5fef8598-2a95-40b1-9cc5-1b855a15de9b" released by "delete_volume" :: held 0.625s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:26:32 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-58a368c3-363b-47ea-a6d6-7c10420f2434 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Created reservations ['12561925-5901-48cb-b174-90740a47d91a', '017b7a92-0e57-4d1b-aa24-1d81022928da', 'cb5f922b-4489-48d0-a8d6-db6f1cc0f241', '836f8b05-7784-491c-ba86-96f06736c0cb'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:26:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-58a368c3-363b-47ea-a6d6-7c10420f2434 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:26:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-58a368c3-363b-47ea-a6d6-7c10420f2434 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:26:32 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-58a368c3-363b-47ea-a6d6-7c10420f2434 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:26:32 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-58a368c3-363b-47ea-a6d6-7c10420f2434 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:26:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-58a368c3-363b-47ea-a6d6-7c10420f2434 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:26:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-58a368c3-363b-47ea-a6d6-7c10420f2434 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:26:32 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:26:32 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:26:32 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Nov 03 13:26:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-58a368c3-363b-47ea-a6d6-7c10420f2434 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.243s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:26:32 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-58a368c3-363b-47ea-a6d6-7c10420f2434 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:26:32 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-58a368c3-363b-47ea-a6d6-7c10420f2434 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Deleted volume successfully. Nov 03 13:26:32 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-58a368c3-363b-47ea-a6d6-7c10420f2434 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "cinder-5fef8598-2a95-40b1-9cc5-1b855a15de9b-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:26:32 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3ff94243-d368-4e6e-b7ba-1899f7f74757 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Acquiring lock "cinder-db3d191c-70b7-43ed-8651-850e8ff420ae-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:26:32 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3ff94243-d368-4e6e-b7ba-1899f7f74757 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "cinder-db3d191c-70b7-43ed-8651-850e8ff420ae-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:26:32 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3ff94243-d368-4e6e-b7ba-1899f7f74757 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Acquiring lock "cinder-quobyte-db3d191c-70b7-43ed-8651-850e8ff420ae" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:26:32 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3ff94243-d368-4e6e-b7ba-1899f7f74757 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "cinder-quobyte-db3d191c-70b7-43ed-8651-850e8ff420ae" acquired by "delete_volume" :: waited 0.015s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:26:32 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61495b9-88ae-4dea-a652-ab592ee9a807]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:26:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3ff94243-d368-4e6e-b7ba-1899f7f74757 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db3d191c-70b7-43ed-8651-850e8ff420ae {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:26:32 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db3d191c-70b7-43ed-8651-850e8ff420ae Nov 03 13:26:32 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:26:33 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Nov 03 13:26:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3ff94243-d368-4e6e-b7ba-1899f7f74757 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db3d191c-70b7-43ed-8651-850e8ff420ae" returned: 0 in 0.366s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:26:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3ff94243-d368-4e6e-b7ba-1899f7f74757 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db3d191c-70b7-43ed-8651-850e8ff420ae {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:26:33 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db3d191c-70b7-43ed-8651-850e8ff420ae Nov 03 13:26:33 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:26:33 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Nov 03 13:26:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3ff94243-d368-4e6e-b7ba-1899f7f74757 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db3d191c-70b7-43ed-8651-850e8ff420ae" returned: 0 in 0.260s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:26:33 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3ff94243-d368-4e6e-b7ba-1899f7f74757 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "cinder-quobyte-db3d191c-70b7-43ed-8651-850e8ff420ae" released by "delete_volume" :: held 0.665s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:26:33 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-3ff94243-d368-4e6e-b7ba-1899f7f74757 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Created reservations ['8a2ee240-ed65-4dcf-9eab-298b00f1b47e', '6cc4e590-35cd-49e3-98a4-3210b06aaa1b', 'c65040bc-1bf0-4319-b656-b1d79a1dd744', 'b22e0f91-eff4-4c40-bee6-6b30f6844ebb'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:26:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3ff94243-d368-4e6e-b7ba-1899f7f74757 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:26:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3ff94243-d368-4e6e-b7ba-1899f7f74757 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:26:33 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3ff94243-d368-4e6e-b7ba-1899f7f74757 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:26:33 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3ff94243-d368-4e6e-b7ba-1899f7f74757 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:26:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3ff94243-d368-4e6e-b7ba-1899f7f74757 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:26:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3ff94243-d368-4e6e-b7ba-1899f7f74757 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:26:33 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:26:33 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:26:33 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Nov 03 13:26:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3ff94243-d368-4e6e-b7ba-1899f7f74757 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.254s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:26:33 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3ff94243-d368-4e6e-b7ba-1899f7f74757 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:26:33 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-3ff94243-d368-4e6e-b7ba-1899f7f74757 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Deleted volume successfully. Nov 03 13:26:33 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3ff94243-d368-4e6e-b7ba-1899f7f74757 tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "cinder-db3d191c-70b7-43ed-8651-850e8ff420ae-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:26:33 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-37e6edfe-db7c-4302-bb28-82f94103cc1c tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Acquiring lock "cinder-ca4ee3ac-01b0-4026-8849-332065687782-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:26:33 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-37e6edfe-db7c-4302-bb28-82f94103cc1c tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "cinder-ca4ee3ac-01b0-4026-8849-332065687782-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:26:33 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-37e6edfe-db7c-4302-bb28-82f94103cc1c tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Acquiring lock "cinder-quobyte-ca4ee3ac-01b0-4026-8849-332065687782" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:26:33 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-37e6edfe-db7c-4302-bb28-82f94103cc1c tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "cinder-quobyte-ca4ee3ac-01b0-4026-8849-332065687782" acquired by "delete_volume" :: waited 0.017s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:26:33 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc92219-5200-4f39-ab5d-5afdd138d6f4]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:26:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37e6edfe-db7c-4302-bb28-82f94103cc1c tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ca4ee3ac-01b0-4026-8849-332065687782 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:26:34 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ca4ee3ac-01b0-4026-8849-332065687782 Nov 03 13:26:34 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:26:34 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Nov 03 13:26:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37e6edfe-db7c-4302-bb28-82f94103cc1c tempest-CreateVolumesFromSourceVolumeTest-800392521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ca4ee3ac-01b0-4026-8849-332065687782" returned: 0 in 0.364s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:26:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37e6edfe-db7c-4302-bb28-82f94103cc1c tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ca4ee3ac-01b0-4026-8849-332065687782 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:26:34 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ca4ee3ac-01b0-4026-8849-332065687782 Nov 03 13:26:34 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:26:34 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Nov 03 13:26:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37e6edfe-db7c-4302-bb28-82f94103cc1c tempest-CreateVolumesFromSourceVolumeTest-800392521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ca4ee3ac-01b0-4026-8849-332065687782" returned: 0 in 0.244s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:26:34 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-37e6edfe-db7c-4302-bb28-82f94103cc1c tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "cinder-quobyte-ca4ee3ac-01b0-4026-8849-332065687782" released by "delete_volume" :: held 0.647s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:26:34 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-37e6edfe-db7c-4302-bb28-82f94103cc1c tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Created reservations ['995d3923-5352-4231-936f-ceab05b88342', '1006a7c3-5963-4d2c-b9a9-ba75ee2027b6', '4289c7a6-438e-48a2-8c27-244e52d33bd3', 'd1d38fb1-ab0d-49ba-80c9-4c3dde6303b3'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:26:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-37e6edfe-db7c-4302-bb28-82f94103cc1c tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:26:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-37e6edfe-db7c-4302-bb28-82f94103cc1c tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:26:34 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-37e6edfe-db7c-4302-bb28-82f94103cc1c tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:26:34 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-37e6edfe-db7c-4302-bb28-82f94103cc1c tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:26:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-37e6edfe-db7c-4302-bb28-82f94103cc1c tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:26:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37e6edfe-db7c-4302-bb28-82f94103cc1c tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:26:34 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:26:34 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:26:34 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Nov 03 13:26:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37e6edfe-db7c-4302-bb28-82f94103cc1c tempest-CreateVolumesFromSourceVolumeTest-800392521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.243s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:26:34 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-37e6edfe-db7c-4302-bb28-82f94103cc1c tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:26:34 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-37e6edfe-db7c-4302-bb28-82f94103cc1c tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Deleted volume successfully. Nov 03 13:26:34 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-37e6edfe-db7c-4302-bb28-82f94103cc1c tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "cinder-ca4ee3ac-01b0-4026-8849-332065687782-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:26:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-653ac60a-ab44-4b4a-87e1-53a0726ec5ac tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Acquiring lock "cinder-882aa3fc-b327-4074-b924-cd726650e4ff-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:26:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-653ac60a-ab44-4b4a-87e1-53a0726ec5ac tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "cinder-882aa3fc-b327-4074-b924-cd726650e4ff-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:26:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-653ac60a-ab44-4b4a-87e1-53a0726ec5ac tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Acquiring lock "cinder-quobyte-882aa3fc-b327-4074-b924-cd726650e4ff" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:26:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-653ac60a-ab44-4b4a-87e1-53a0726ec5ac tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "cinder-quobyte-882aa3fc-b327-4074-b924-cd726650e4ff" acquired by "delete_volume" :: waited 0.016s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:26:35 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d985bb-a940-4bd8-abb9-f68dda252949]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:26:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-653ac60a-ab44-4b4a-87e1-53a0726ec5ac tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-882aa3fc-b327-4074-b924-cd726650e4ff {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:26:35 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-882aa3fc-b327-4074-b924-cd726650e4ff Nov 03 13:26:35 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:26:35 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Nov 03 13:26:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-653ac60a-ab44-4b4a-87e1-53a0726ec5ac tempest-CreateVolumesFromSourceVolumeTest-800392521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-882aa3fc-b327-4074-b924-cd726650e4ff" returned: 0 in 0.353s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:26:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-653ac60a-ab44-4b4a-87e1-53a0726ec5ac tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-882aa3fc-b327-4074-b924-cd726650e4ff {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:26:35 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-882aa3fc-b327-4074-b924-cd726650e4ff Nov 03 13:26:35 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:26:35 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Nov 03 13:26:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-653ac60a-ab44-4b4a-87e1-53a0726ec5ac tempest-CreateVolumesFromSourceVolumeTest-800392521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-882aa3fc-b327-4074-b924-cd726650e4ff" returned: 0 in 0.241s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:26:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-653ac60a-ab44-4b4a-87e1-53a0726ec5ac tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "cinder-quobyte-882aa3fc-b327-4074-b924-cd726650e4ff" released by "delete_volume" :: held 0.638s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:26:35 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-653ac60a-ab44-4b4a-87e1-53a0726ec5ac tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Created reservations ['1d82ba33-d5d1-48f7-81a3-b9772d61e64a', '0489b2db-4284-4e2c-b1c2-c9a5aaf80e3c', 'ae0971a7-1d5d-4d90-8fd2-7a70f3781d9c', '3f684275-bec1-42ba-a3a4-b6f45b41ebda'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:26:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-653ac60a-ab44-4b4a-87e1-53a0726ec5ac tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:26:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-653ac60a-ab44-4b4a-87e1-53a0726ec5ac tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:26:35 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-653ac60a-ab44-4b4a-87e1-53a0726ec5ac tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:26:35 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-653ac60a-ab44-4b4a-87e1-53a0726ec5ac tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:26:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-653ac60a-ab44-4b4a-87e1-53a0726ec5ac tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:26:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-653ac60a-ab44-4b4a-87e1-53a0726ec5ac tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:26:35 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:26:35 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:26:36 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Nov 03 13:26:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-653ac60a-ab44-4b4a-87e1-53a0726ec5ac tempest-CreateVolumesFromSourceVolumeTest-800392521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.249s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:26:36 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-653ac60a-ab44-4b4a-87e1-53a0726ec5ac tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:26:36 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-653ac60a-ab44-4b4a-87e1-53a0726ec5ac tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Deleted volume successfully. Nov 03 13:26:36 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-653ac60a-ab44-4b4a-87e1-53a0726ec5ac tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "cinder-882aa3fc-b327-4074-b924-cd726650e4ff-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:26:36 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-40b61269-30a5-43c1-8c97-c32b4ed1977f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Acquiring lock "cinder-dc9b9288-cd30-4af5-91ab-cf63015891ea-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:26:36 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-40b61269-30a5-43c1-8c97-c32b4ed1977f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "cinder-dc9b9288-cd30-4af5-91ab-cf63015891ea-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:26:36 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-40b61269-30a5-43c1-8c97-c32b4ed1977f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Acquiring lock "cinder-quobyte-dc9b9288-cd30-4af5-91ab-cf63015891ea" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:26:36 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-40b61269-30a5-43c1-8c97-c32b4ed1977f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "cinder-quobyte-dc9b9288-cd30-4af5-91ab-cf63015891ea" acquired by "delete_volume" :: waited 0.014s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:26:36 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[483601bd-7f42-48b2-9fd9-4f517ea1b48e]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:26:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40b61269-30a5-43c1-8c97-c32b4ed1977f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-dc9b9288-cd30-4af5-91ab-cf63015891ea {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:26:36 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-dc9b9288-cd30-4af5-91ab-cf63015891ea Nov 03 13:26:36 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:26:36 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Nov 03 13:26:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40b61269-30a5-43c1-8c97-c32b4ed1977f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-dc9b9288-cd30-4af5-91ab-cf63015891ea" returned: 0 in 0.356s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:26:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40b61269-30a5-43c1-8c97-c32b4ed1977f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-dc9b9288-cd30-4af5-91ab-cf63015891ea {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:26:36 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-dc9b9288-cd30-4af5-91ab-cf63015891ea Nov 03 13:26:36 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:26:36 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Nov 03 13:26:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40b61269-30a5-43c1-8c97-c32b4ed1977f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-dc9b9288-cd30-4af5-91ab-cf63015891ea" returned: 0 in 0.236s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:26:36 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-40b61269-30a5-43c1-8c97-c32b4ed1977f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "cinder-quobyte-dc9b9288-cd30-4af5-91ab-cf63015891ea" released by "delete_volume" :: held 0.632s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:26:36 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-40b61269-30a5-43c1-8c97-c32b4ed1977f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Created reservations ['bce0845b-b535-4f8b-871a-92b572a52a8b', '843e53fc-ddd7-4bfb-b3a5-9c45e1a118b2', '707cdf31-8b42-446f-ae6e-6b43c71c6ca2', '3b7d0c21-d2ea-43ac-bf98-46e559429cb0'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:26:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-40b61269-30a5-43c1-8c97-c32b4ed1977f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:26:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-40b61269-30a5-43c1-8c97-c32b4ed1977f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:26:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-40b61269-30a5-43c1-8c97-c32b4ed1977f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:26:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-40b61269-30a5-43c1-8c97-c32b4ed1977f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:26:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-40b61269-30a5-43c1-8c97-c32b4ed1977f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:26:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40b61269-30a5-43c1-8c97-c32b4ed1977f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:26:37 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:26:37 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:26:37 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Nov 03 13:26:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40b61269-30a5-43c1-8c97-c32b4ed1977f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.240s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:26:37 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-40b61269-30a5-43c1-8c97-c32b4ed1977f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:26:37 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-40b61269-30a5-43c1-8c97-c32b4ed1977f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Deleted volume successfully. Nov 03 13:26:37 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-40b61269-30a5-43c1-8c97-c32b4ed1977f tempest-CreateVolumesFromSourceVolumeTest-800392521 None] Lock "cinder-dc9b9288-cd30-4af5-91ab-cf63015891ea-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:26:46 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:UPDATE=64,cinder:SELECT=42,cinder:INSERT=18,cinder:DELETE=6 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:26:47 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=42,cinder:UPDATE=68,cinder:DELETE=6,cinder:INSERT=12 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:26:58 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:26:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:26:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:26:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:26:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:26:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:26:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:26:58 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:26:58 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:26:59 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Nov 03 13:26:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.252s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:26:59 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:26:59 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager._thread_info {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:26:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread count: 28 {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:26:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread info: [<_MainThread(MainThread, started 133507074375808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:27:04 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:27:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] Flow 'volume_create_manager' (55623a20-877c-452f-b91d-fab2ff56be4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:27:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a466960f-e550-4f26-9baf-a7281e8dd98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a466960f-e550-4f26-9baf-a7281e8dd98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1330654651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ca6ada3-10c0-4592-a34c-a6a9f224e2e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952d5f61bbe440eb8af9369605c0f958',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:27:05Z,use_quota=True,user_id='9bccc8efd8c843b6a98b8f94f102e1d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb516792-8624-4b69-ac08-6894bf225237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb516792-8624-4b69-ac08-6894bf225237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28445505-c2e5-45cc-9866-0ddd74d3fcab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28445505-c2e5-45cc-9866-0ddd74d3fcab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ca6ada3-10c0-4592-a34c-a6a9f224e2e4', 'volume_name': 'volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7347b920-f936-4318-be85-61ccf967cd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7347b920-f936-4318-be85-61ccf967cd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3612eaf7-0c07-43de-994e-deb6ae82224e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:04 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] Volume 1ca6ada3-10c0-4592-a34c-a6a9f224e2e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4', 'volume_size': 1} Nov 03 13:27:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:04 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1330654651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ca6ada3-10c0-4592-a34c-a6a9f224e2e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952d5f61bbe440eb8af9369605c0f958',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:27:05Z,use_quota=True,user_id='9bccc8efd8c843b6a98b8f94f102e1d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:27:04 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] Creating volume 1ca6ada3-10c0-4592-a34c-a6a9f224e2e4 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:27:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:04 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:27:04 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:27:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:04 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:27:04 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:27:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:04 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4 1073741824 Nov 03 13:27:04 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:05 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4 1073741824" returned: 0 in 0.417s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:05 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4 Nov 03 13:27:05 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:05 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4" returned: 0 in 0.249s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:05 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:27:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:05 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3612eaf7-0c07-43de-994e-deb6ae82224e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:05 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (807a4c92-540e-48e8-988f-52cfd02540af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:05 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] Volume volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4 (1ca6ada3-10c0-4592-a34c-a6a9f224e2e4): created successfully Nov 03 13:27:05 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (807a4c92-540e-48e8-988f-52cfd02540af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:05 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] Flow 'volume_create_manager' (55623a20-877c-452f-b91d-fab2ff56be4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:27:05 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-f44b6de1-acb6-46ae-95e2-58fa00cb1811 tempest-SnapshotDependencyTests-1499099441 None] Created volume successfully. Nov 03 13:27:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d7ab2beb-e642-4585-8f02-e92ba5d595b1 tempest-SnapshotDependencyTests-1499099441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d7ab2beb-e642-4585-8f02-e92ba5d595b1 tempest-SnapshotDependencyTests-1499099441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:05 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-d7ab2beb-e642-4585-8f02-e92ba5d595b1 tempest-SnapshotDependencyTests-1499099441 None] Creating offline snapshot 67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c of volume 1ca6ada3-10c0-4592-a34c-a6a9f224e2e4 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:27:05 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92e5e70-3fe6-436d-9637-cb4df07202bb]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:27:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d7ab2beb-e642-4585-8f02-e92ba5d595b1 tempest-SnapshotDependencyTests-1499099441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:05 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4 Nov 03 13:27:05 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:06 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d7ab2beb-e642-4585-8f02-e92ba5d595b1 tempest-SnapshotDependencyTests-1499099441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4" returned: 0 in 0.350s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d7ab2beb-e642-4585-8f02-e92ba5d595b1 tempest-SnapshotDependencyTests-1499099441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4.67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:06 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4.67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c 1G Nov 03 13:27:06 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:06 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d7ab2beb-e642-4585-8f02-e92ba5d595b1 tempest-SnapshotDependencyTests-1499099441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4.67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c 1G" returned: 0 in 0.371s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d7ab2beb-e642-4585-8f02-e92ba5d595b1 tempest-SnapshotDependencyTests-1499099441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4.67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:06 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4.67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c Nov 03 13:27:06 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:06 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d7ab2beb-e642-4585-8f02-e92ba5d595b1 tempest-SnapshotDependencyTests-1499099441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4.67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c" returned: 0 in 0.279s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:06 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-d7ab2beb-e642-4585-8f02-e92ba5d595b1 tempest-SnapshotDependencyTests-1499099441 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4.67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c is being set with open permissions: ugo+rw Nov 03 13:27:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d7ab2beb-e642-4585-8f02-e92ba5d595b1 tempest-SnapshotDependencyTests-1499099441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4.67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:06 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4.67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c Nov 03 13:27:06 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:07 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d7ab2beb-e642-4585-8f02-e92ba5d595b1 tempest-SnapshotDependencyTests-1499099441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4.67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c" returned: 0 in 0.234s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d7ab2beb-e642-4585-8f02-e92ba5d595b1 tempest-SnapshotDependencyTests-1499099441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:07 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4.info Nov 03 13:27:07 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:07 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d7ab2beb-e642-4585-8f02-e92ba5d595b1 tempest-SnapshotDependencyTests-1499099441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4.info" returned: 0 in 0.241s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:07 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-d7ab2beb-e642-4585-8f02-e92ba5d595b1 tempest-SnapshotDependencyTests-1499099441 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4.info is being set with open permissions: ugo+rw Nov 03 13:27:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d7ab2beb-e642-4585-8f02-e92ba5d595b1 tempest-SnapshotDependencyTests-1499099441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:07 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4.info Nov 03 13:27:07 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:07 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d7ab2beb-e642-4585-8f02-e92ba5d595b1 tempest-SnapshotDependencyTests-1499099441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4.info" returned: 0 in 0.237s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d7ab2beb-e642-4585-8f02-e92ba5d595b1 tempest-SnapshotDependencyTests-1499099441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.793s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:07 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-d7ab2beb-e642-4585-8f02-e92ba5d595b1 tempest-SnapshotDependencyTests-1499099441 None] Create snapshot completed successfully Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Flow 'volume_create_manager' (99baff61-a0ec-4158-876f-af6333387016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e58ede3a-23d6-416a-b680-9f251bb64de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e58ede3a-23d6-416a-b680-9f251bb64de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b2fd339-98e6-4efe-9f8e-ffec11249609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952d5f61bbe440eb8af9369605c0f958',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:27:08Z,use_quota=True,user_id='9bccc8efd8c843b6a98b8f94f102e1d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f146fb5e-49f7-4e55-88f7-86c5f80c317c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f146fb5e-49f7-4e55-88f7-86c5f80c317c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bddcccc-8545-4495-8dca-47a7b85e63d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bddcccc-8545-4495-8dca-47a7b85e63d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3b2fd339-98e6-4efe-9f8e-ffec11249609', 'volume_name': 'volume-3b2fd339-98e6-4efe-9f8e-ffec11249609', 'volume_size': 1, 'snapshot_id': '67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c'}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6314da77-cbf2-4fd6-aac5-7d976c6469cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6314da77-cbf2-4fd6-aac5-7d976c6469cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4c0f507-9916-4b27-8609-b654ff024841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:08 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Volume 3b2fd339-98e6-4efe-9f8e-ffec11249609: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3b2fd339-98e6-4efe-9f8e-ffec11249609', 'volume_size': 1, 'snapshot_id': '67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c'} Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Acquiring lock "cinder-quobyte-67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c-3b2fd339-98e6-4efe-9f8e-ffec11249609" by "_create_volume_from_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Lock "cinder-quobyte-67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c-3b2fd339-98e6-4efe-9f8e-ffec11249609" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Creating volume 3b2fd339-98e6-4efe-9f8e-ffec11249609 from snapshot 67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c {{(pid=86725) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Acquiring lock "cinder-quobyte-3b2fd339-98e6-4efe-9f8e-ffec11249609" by "_copy_volume_from_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Lock "cinder-quobyte-3b2fd339-98e6-4efe-9f8e-ffec11249609" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] snapshot: 67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c, volume: 3b2fd339-98e6-4efe-9f8e-ffec11249609, {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f98dfd-b3f0-45fa-99de-4d83d86c58ca]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4.67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:08 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4.67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c Nov 03 13:27:08 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:08 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4.67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c" returned: 0 in 0.342s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9006e3-b053-4606-ba78-c0f0fac372f3]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:27:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:09 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4 Nov 03 13:27:09 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:09 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4" returned: 0 in 0.344s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:09 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4 {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 13:27:09 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Creating direct copy from snapshot {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 13:27:09 devstack cinder-volume[86725]: DEBUG cinder.utils [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Path /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3b2fd339-98e6-4efe-9f8e-ffec11249609 not found in is_blk_device check {{(pid=86725) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 13:27:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3b2fd339-98e6-4efe-9f8e-ffec11249609 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:09 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3b2fd339-98e6-4efe-9f8e-ffec11249609 Nov 03 13:27:09 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:15 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3b2fd339-98e6-4efe-9f8e-ffec11249609" returned: 0 in 6.103s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:15 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4, size 1024.00 MB, duration 6.10 sec, destination /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3b2fd339-98e6-4efe-9f8e-ffec11249609 {{(pid=86725) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:27:15 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Converted 1024.00 MB image at 167.75 MB/s Nov 03 13:27:15 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3b2fd339-98e6-4efe-9f8e-ffec11249609 is being set with open permissions: ugo+rw Nov 03 13:27:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3b2fd339-98e6-4efe-9f8e-ffec11249609 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:15 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3b2fd339-98e6-4efe-9f8e-ffec11249609 Nov 03 13:27:15 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:15 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3b2fd339-98e6-4efe-9f8e-ffec11249609" returned: 0 in 0.237s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:15 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Lock "cinder-quobyte-3b2fd339-98e6-4efe-9f8e-ffec11249609" released by "_copy_volume_from_snapshot" :: held 7.106s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:27:15 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Lock "cinder-quobyte-67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c-3b2fd339-98e6-4efe-9f8e-ffec11249609" released by "_create_volume_from_snapshot" :: held 7.162s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:27:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.177s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:15 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4c0f507-9916-4b27-8609-b654ff024841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b2fd339-98e6-4efe-9f8e-ffec11249609', 'volume_size': 1, 'snapshot_id': '67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c'}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:15 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (854b22fb-e955-4e0c-8b4a-ae2c004c2d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:15 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Volume volume-3b2fd339-98e6-4efe-9f8e-ffec11249609 (3b2fd339-98e6-4efe-9f8e-ffec11249609): created successfully Nov 03 13:27:15 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (854b22fb-e955-4e0c-8b4a-ae2c004c2d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:15 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Flow 'volume_create_manager' (99baff61-a0ec-4158-876f-af6333387016) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:27:15 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-1c53f230-7418-47bc-97c4-0c44eb4ad04f tempest-SnapshotDependencyTests-1499099441 None] Created volume successfully. Nov 03 13:27:16 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-827c63ce-c689-41fc-b45f-b2e5df3ffde4 tempest-SnapshotDependencyTests-1499099441 None] Acquiring lock "cinder-67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:27:16 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-827c63ce-c689-41fc-b45f-b2e5df3ffde4 tempest-SnapshotDependencyTests-1499099441 None] Lock "cinder-67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:27:16 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-827c63ce-c689-41fc-b45f-b2e5df3ffde4 tempest-SnapshotDependencyTests-1499099441 None] Acquiring lock "cinder-quobyte-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:27:16 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-827c63ce-c689-41fc-b45f-b2e5df3ffde4 tempest-SnapshotDependencyTests-1499099441 None] Lock "cinder-quobyte-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:27:16 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-827c63ce-c689-41fc-b45f-b2e5df3ffde4 tempest-SnapshotDependencyTests-1499099441 None] Acquiring lock "cinder-quobyte-67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:27:16 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-827c63ce-c689-41fc-b45f-b2e5df3ffde4 tempest-SnapshotDependencyTests-1499099441 None] Lock "cinder-quobyte-67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:27:16 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-827c63ce-c689-41fc-b45f-b2e5df3ffde4 tempest-SnapshotDependencyTests-1499099441 None] Deleting offline snapshot 67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c of volume 1ca6ada3-10c0-4592-a34c-a6a9f224e2e4 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:27:16 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-827c63ce-c689-41fc-b45f-b2e5df3ffde4 tempest-SnapshotDependencyTests-1499099441 None] snapshot_file for this snap is: volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4.67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:27:16 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f93181b-319b-4c8b-a5e1-aa8eac8e30af]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:27:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-827c63ce-c689-41fc-b45f-b2e5df3ffde4 tempest-SnapshotDependencyTests-1499099441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4.67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:16 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4.67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c Nov 03 13:27:16 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:16 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-827c63ce-c689-41fc-b45f-b2e5df3ffde4 tempest-SnapshotDependencyTests-1499099441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4.67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c" returned: 0 in 0.360s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:16 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-827c63ce-c689-41fc-b45f-b2e5df3ffde4 tempest-SnapshotDependencyTests-1499099441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:27:16 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[051049d0-d20f-4299-9acf-c5b320ddbc8d]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:27:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-827c63ce-c689-41fc-b45f-b2e5df3ffde4 tempest-SnapshotDependencyTests-1499099441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:16 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4 Nov 03 13:27:16 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:17 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-827c63ce-c689-41fc-b45f-b2e5df3ffde4 tempest-SnapshotDependencyTests-1499099441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4" returned: 0 in 0.537s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-827c63ce-c689-41fc-b45f-b2e5df3ffde4 tempest-SnapshotDependencyTests-1499099441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4.67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:17 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4.67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c Nov 03 13:27:17 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:17 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-827c63ce-c689-41fc-b45f-b2e5df3ffde4 tempest-SnapshotDependencyTests-1499099441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4.67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c" returned: 0 in 0.327s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-827c63ce-c689-41fc-b45f-b2e5df3ffde4 tempest-SnapshotDependencyTests-1499099441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4.67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:17 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4.67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c Nov 03 13:27:17 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:17 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-827c63ce-c689-41fc-b45f-b2e5df3ffde4 tempest-SnapshotDependencyTests-1499099441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4.67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c" returned: 0 in 0.240s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:17 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-827c63ce-c689-41fc-b45f-b2e5df3ffde4 tempest-SnapshotDependencyTests-1499099441 None] Lock "cinder-quobyte-67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c" released by "_delete_snapshot" :: held 1.564s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:27:17 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-827c63ce-c689-41fc-b45f-b2e5df3ffde4 tempest-SnapshotDependencyTests-1499099441 None] Lock "cinder-quobyte-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4" released by "delete_snapshot" :: held 1.586s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:27:17 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-827c63ce-c689-41fc-b45f-b2e5df3ffde4 tempest-SnapshotDependencyTests-1499099441 None] Created reservations ['aed0b675-c915-471a-b538-09553f809fd7', 'af261bd4-0dc0-4de5-a34a-356158f28112', '55a1f6f4-7729-43f9-956d-ba59d9b57f7d', '4fc80d32-8432-45df-ad62-76ed481c2b02'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:27:18 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-827c63ce-c689-41fc-b45f-b2e5df3ffde4 tempest-SnapshotDependencyTests-1499099441 None] Delete snapshot completed successfully. Nov 03 13:27:18 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-827c63ce-c689-41fc-b45f-b2e5df3ffde4 tempest-SnapshotDependencyTests-1499099441 None] Lock "cinder-67b61d2c-7273-4a25-b2fa-ca5f25fe9d5c-delete_snapshot" released by "delete_snapshot" :: held 1.717s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:27:18 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4ae8044c-96cf-4e04-baa0-65a2233d69ca tempest-SnapshotDependencyTests-1499099441 None] Acquiring lock "cinder-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:27:18 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4ae8044c-96cf-4e04-baa0-65a2233d69ca tempest-SnapshotDependencyTests-1499099441 None] Lock "cinder-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:27:18 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4ae8044c-96cf-4e04-baa0-65a2233d69ca tempest-SnapshotDependencyTests-1499099441 None] Acquiring lock "cinder-quobyte-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:27:18 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4ae8044c-96cf-4e04-baa0-65a2233d69ca tempest-SnapshotDependencyTests-1499099441 None] Lock "cinder-quobyte-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4" acquired by "delete_volume" :: waited 0.016s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:27:18 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e943ad-1170-464b-b3f2-73136eb3a80b]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:27:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4ae8044c-96cf-4e04-baa0-65a2233d69ca tempest-SnapshotDependencyTests-1499099441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:18 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4 Nov 03 13:27:18 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:18 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4ae8044c-96cf-4e04-baa0-65a2233d69ca tempest-SnapshotDependencyTests-1499099441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4" returned: 0 in 0.348s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4ae8044c-96cf-4e04-baa0-65a2233d69ca tempest-SnapshotDependencyTests-1499099441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:18 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4 Nov 03 13:27:18 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:19 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4ae8044c-96cf-4e04-baa0-65a2233d69ca tempest-SnapshotDependencyTests-1499099441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4" returned: 0 in 0.246s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:19 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4ae8044c-96cf-4e04-baa0-65a2233d69ca tempest-SnapshotDependencyTests-1499099441 None] Lock "cinder-quobyte-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4" released by "delete_volume" :: held 0.652s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:27:19 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-4ae8044c-96cf-4e04-baa0-65a2233d69ca tempest-SnapshotDependencyTests-1499099441 None] Created reservations ['736e99a2-7180-4518-b676-032fcaed5ef8', '060ed448-ba74-4f68-bfc7-26c751039c20', '3a009c24-3b66-4dbb-8a19-d32d701118b9', '291c20d8-c89a-42fb-b18b-26ef68b5c9d9'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:27:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4ae8044c-96cf-4e04-baa0-65a2233d69ca tempest-SnapshotDependencyTests-1499099441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4ae8044c-96cf-4e04-baa0-65a2233d69ca tempest-SnapshotDependencyTests-1499099441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:19 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4ae8044c-96cf-4e04-baa0-65a2233d69ca tempest-SnapshotDependencyTests-1499099441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:27:19 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4ae8044c-96cf-4e04-baa0-65a2233d69ca tempest-SnapshotDependencyTests-1499099441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:27:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4ae8044c-96cf-4e04-baa0-65a2233d69ca tempest-SnapshotDependencyTests-1499099441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4ae8044c-96cf-4e04-baa0-65a2233d69ca tempest-SnapshotDependencyTests-1499099441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:19 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:27:19 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:19 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4ae8044c-96cf-4e04-baa0-65a2233d69ca tempest-SnapshotDependencyTests-1499099441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.251s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:19 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-4ae8044c-96cf-4e04-baa0-65a2233d69ca tempest-SnapshotDependencyTests-1499099441 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:27:19 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-4ae8044c-96cf-4e04-baa0-65a2233d69ca tempest-SnapshotDependencyTests-1499099441 None] Deleted volume successfully. Nov 03 13:27:19 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4ae8044c-96cf-4e04-baa0-65a2233d69ca tempest-SnapshotDependencyTests-1499099441 None] Lock "cinder-1ca6ada3-10c0-4592-a34c-a6a9f224e2e4-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:27:19 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-80795e01-7c7a-4520-b8e0-73057060c195 tempest-SnapshotDependencyTests-1499099441 None] Acquiring lock "cinder-3b2fd339-98e6-4efe-9f8e-ffec11249609-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:27:19 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-80795e01-7c7a-4520-b8e0-73057060c195 tempest-SnapshotDependencyTests-1499099441 None] Lock "cinder-3b2fd339-98e6-4efe-9f8e-ffec11249609-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:27:19 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-80795e01-7c7a-4520-b8e0-73057060c195 tempest-SnapshotDependencyTests-1499099441 None] Acquiring lock "cinder-quobyte-3b2fd339-98e6-4efe-9f8e-ffec11249609" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:27:19 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-80795e01-7c7a-4520-b8e0-73057060c195 tempest-SnapshotDependencyTests-1499099441 None] Lock "cinder-quobyte-3b2fd339-98e6-4efe-9f8e-ffec11249609" acquired by "delete_volume" :: waited 0.013s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:27:19 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[355fc330-708a-42ca-ad90-03de57e999fc]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:27:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-80795e01-7c7a-4520-b8e0-73057060c195 tempest-SnapshotDependencyTests-1499099441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3b2fd339-98e6-4efe-9f8e-ffec11249609 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:19 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3b2fd339-98e6-4efe-9f8e-ffec11249609 Nov 03 13:27:19 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:20 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-80795e01-7c7a-4520-b8e0-73057060c195 tempest-SnapshotDependencyTests-1499099441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3b2fd339-98e6-4efe-9f8e-ffec11249609" returned: 0 in 0.356s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-80795e01-7c7a-4520-b8e0-73057060c195 tempest-SnapshotDependencyTests-1499099441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3b2fd339-98e6-4efe-9f8e-ffec11249609 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:20 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3b2fd339-98e6-4efe-9f8e-ffec11249609 Nov 03 13:27:20 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:20 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-80795e01-7c7a-4520-b8e0-73057060c195 tempest-SnapshotDependencyTests-1499099441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-3b2fd339-98e6-4efe-9f8e-ffec11249609" returned: 0 in 0.244s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:20 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-80795e01-7c7a-4520-b8e0-73057060c195 tempest-SnapshotDependencyTests-1499099441 None] Lock "cinder-quobyte-3b2fd339-98e6-4efe-9f8e-ffec11249609" released by "delete_volume" :: held 0.641s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:27:20 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-80795e01-7c7a-4520-b8e0-73057060c195 tempest-SnapshotDependencyTests-1499099441 None] Created reservations ['fa55ef6f-5712-4f74-a67f-2631c3b67e90', '664bd457-ed3e-4732-9481-46fe52192b8b', 'a6eac55d-a062-4d0a-b481-6299cb3e5e53', 'd53ca6f3-b115-4198-a149-8d2664d7d5b3'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:27:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-80795e01-7c7a-4520-b8e0-73057060c195 tempest-SnapshotDependencyTests-1499099441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-80795e01-7c7a-4520-b8e0-73057060c195 tempest-SnapshotDependencyTests-1499099441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:20 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-80795e01-7c7a-4520-b8e0-73057060c195 tempest-SnapshotDependencyTests-1499099441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:27:20 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-80795e01-7c7a-4520-b8e0-73057060c195 tempest-SnapshotDependencyTests-1499099441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:27:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-80795e01-7c7a-4520-b8e0-73057060c195 tempest-SnapshotDependencyTests-1499099441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-80795e01-7c7a-4520-b8e0-73057060c195 tempest-SnapshotDependencyTests-1499099441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:20 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:27:20 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:20 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-80795e01-7c7a-4520-b8e0-73057060c195 tempest-SnapshotDependencyTests-1499099441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.242s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:20 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-80795e01-7c7a-4520-b8e0-73057060c195 tempest-SnapshotDependencyTests-1499099441 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:27:20 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-80795e01-7c7a-4520-b8e0-73057060c195 tempest-SnapshotDependencyTests-1499099441 None] Deleted volume successfully. Nov 03 13:27:20 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-80795e01-7c7a-4520-b8e0-73057060c195 tempest-SnapshotDependencyTests-1499099441 None] Lock "cinder-3b2fd339-98e6-4efe-9f8e-ffec11249609-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:27:32 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=25,cinder:UPDATE=30,cinder:INSERT=10,cinder:DELETE=1 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:27:32 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=25,cinder:UPDATE=29,cinder:DELETE=4,cinder:INSERT=5 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] Flow 'volume_create_manager' (27f5e80a-afdc-4f93-bc8a-636ba9226c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94c3dd22-9926-4b46-9fc2-094c70b95a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94c3dd22-9926-4b46-9fc2-094c70b95a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2055268125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=777bf02a-85b8-4b70-b4d9-93eb96beb7fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fa2e70a52f84acd9a32dfb40a60e2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:27:41Z,use_quota=True,user_id='487b665e8e2e482c905a3edf167cde15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35e6050b-b7db-4a7f-8ce9-e7ec597d5b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35e6050b-b7db-4a7f-8ce9-e7ec597d5b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88781d08-948a-4165-900b-dd19bcbc544a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88781d08-948a-4165-900b-dd19bcbc544a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '777bf02a-85b8-4b70-b4d9-93eb96beb7fc', 'volume_name': 'volume-777bf02a-85b8-4b70-b4d9-93eb96beb7fc', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9bd58c-86ad-488a-bd33-76b3f466af09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9bd58c-86ad-488a-bd33-76b3f466af09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb16d7a2-72d9-4f8d-9394-7f1e5f79e0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:41 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] Volume 777bf02a-85b8-4b70-b4d9-93eb96beb7fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-777bf02a-85b8-4b70-b4d9-93eb96beb7fc', 'volume_size': 1} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2055268125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=777bf02a-85b8-4b70-b4d9-93eb96beb7fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fa2e70a52f84acd9a32dfb40a60e2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:27:41Z,use_quota=True,user_id='487b665e8e2e482c905a3edf167cde15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] Creating volume 777bf02a-85b8-4b70-b4d9-93eb96beb7fc {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:27:41 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-777bf02a-85b8-4b70-b4d9-93eb96beb7fc 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:27:41 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-777bf02a-85b8-4b70-b4d9-93eb96beb7fc 1073741824 Nov 03 13:27:41 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Flow 'volume_create_manager' (2c602b2a-4852-4d2d-8503-bcb660715430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b30ee6-b565-455f-8db2-1191f59bbe80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b30ee6-b565-455f-8db2-1191f59bbe80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2142664244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68765115-991e-40da-b912-b8e76d1537ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad74210e3b154cfaae8409585ab92055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:27:41Z,use_quota=True,user_id='35bf0a206a824d0680e6923b93c4bbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed0b6eb-bd35-4f91-9da7-959ad56a0e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed0b6eb-bd35-4f91-9da7-959ad56a0e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43e4ded3-5840-430d-99bd-94bca80da715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43e4ded3-5840-430d-99bd-94bca80da715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68765115-991e-40da-b912-b8e76d1537ce', 'volume_name': 'volume-68765115-991e-40da-b912-b8e76d1537ce', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b46feff-692c-4cc8-9d36-f6d874d83544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b46feff-692c-4cc8-9d36-f6d874d83544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ce9bde9-37bf-4d9b-99b3-f31ec2b31657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:41 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Volume 68765115-991e-40da-b912-b8e76d1537ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68765115-991e-40da-b912-b8e76d1537ce', 'volume_size': 1} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] Flow 'volume_create_manager' (664790c5-ed0a-4b33-8272-4b06a7ad42c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d50059d8-aeaa-422a-993b-adf08939412b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d50059d8-aeaa-422a-993b-adf08939412b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-831305816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=250c8842-9359-434c-8fbb-fbfb4bd3382c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fa2e70a52f84acd9a32dfb40a60e2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:27:42Z,use_quota=True,user_id='487b665e8e2e482c905a3edf167cde15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a12c5a45-d2f9-4a79-9fc5-8bf2ecc3b5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a12c5a45-d2f9-4a79-9fc5-8bf2ecc3b5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcde82f9-15cb-4d7f-8199-60c03effa7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcde82f9-15cb-4d7f-8199-60c03effa7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '250c8842-9359-434c-8fbb-fbfb4bd3382c', 'volume_name': 'volume-250c8842-9359-434c-8fbb-fbfb4bd3382c', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75e3f773-f4d1-40a1-b501-2a2a826bb519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75e3f773-f4d1-40a1-b501-2a2a826bb519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d54f46-6c29-4231-bf4f-cf88b0dbc921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:41 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] Volume 250c8842-9359-434c-8fbb-fbfb4bd3382c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-250c8842-9359-434c-8fbb-fbfb4bd3382c', 'volume_size': 1} Nov 03 13:27:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:27:42 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] Flow 'volume_create_manager' (03bf3f6f-587c-4da9-bf5f-0b1023c61110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f614739-ca78-44c0-bda1-c16d0552dbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-777bf02a-85b8-4b70-b4d9-93eb96beb7fc 1073741824" returned: 0 in 0.702s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f614739-ca78-44c0-bda1-c16d0552dbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2023323993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ed0551-ac41-4162-83b3-09f7624dfe78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88025e4dcbe64d47b569aae85e963d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:27:42Z,use_quota=True,user_id='989d3c641bf845bfa8dac174b4e1b4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42dd5973-67e6-411a-813f-49ffb5721cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42dd5973-67e6-411a-813f-49ffb5721cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b83a17d-057e-416f-a951-18334f195ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b83a17d-057e-416f-a951-18334f195ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62ed0551-ac41-4162-83b3-09f7624dfe78', 'volume_name': 'volume-62ed0551-ac41-4162-83b3-09f7624dfe78', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf958ca-5080-4017-aeb6-8a2f7f182e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf958ca-5080-4017-aeb6-8a2f7f182e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0a356cb-4820-451e-97b7-6186a68aae76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:42 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] Volume 62ed0551-ac41-4162-83b3-09f7624dfe78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62ed0551-ac41-4162-83b3-09f7624dfe78', 'volume_size': 1} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] Flow 'volume_create_manager' (f28a03c9-46fc-4184-9b98-4b024a69c9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e42bb6-8508-405e-b727-928116041432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-777bf02a-85b8-4b70-b4d9-93eb96beb7fc {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e42bb6-8508-405e-b727-928116041432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1425177213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c780359-d0fa-4d2a-bc88-22bc57451f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fa2e70a52f84acd9a32dfb40a60e2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:27:42Z,use_quota=True,user_id='487b665e8e2e482c905a3edf167cde15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (809e03dc-5bb2-4310-87d9-c309be6bca5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:42 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-777bf02a-85b8-4b70-b4d9-93eb96beb7fc Nov 03 13:27:42 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (809e03dc-5bb2-4310-87d9-c309be6bca5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de7acfb-0a34-461f-94c2-3cbf93d2a0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de7acfb-0a34-461f-94c2-3cbf93d2a0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c780359-d0fa-4d2a-bc88-22bc57451f90', 'volume_name': 'volume-0c780359-d0fa-4d2a-bc88-22bc57451f90', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ad7893-9c7e-40db-bebd-f486aa973dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ad7893-9c7e-40db-bebd-f486aa973dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5086473a-581e-455b-a6de-571064bc6830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:42 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] Volume 0c780359-d0fa-4d2a-bc88-22bc57451f90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c780359-d0fa-4d2a-bc88-22bc57451f90', 'volume_size': 1} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] Flow 'volume_create_manager' (4d47122a-b185-4d69-afc7-d01488550692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13580221-1873-464e-a6d2-4dfc0e156b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13580221-1873-464e-a6d2-4dfc0e156b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1067988381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e1e6ede-5dd7-4e43-8e70-8e46f23fa066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fa2e70a52f84acd9a32dfb40a60e2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:27:43Z,use_quota=True,user_id='487b665e8e2e482c905a3edf167cde15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bd6b877-a51c-4a5e-95b3-f39b579b0c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bd6b877-a51c-4a5e-95b3-f39b579b0c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc0d3645-9143-490f-ad10-6491de5bbc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc0d3645-9143-490f-ad10-6491de5bbc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e1e6ede-5dd7-4e43-8e70-8e46f23fa066', 'volume_name': 'volume-1e1e6ede-5dd7-4e43-8e70-8e46f23fa066', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b2a9226-3ea6-4ebf-8b13-e72eddf4b2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b2a9226-3ea6-4ebf-8b13-e72eddf4b2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be147c73-6ad2-43b5-a695-91ee50bc2300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:42 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] Volume 1e1e6ede-5dd7-4e43-8e70-8e46f23fa066: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e1e6ede-5dd7-4e43-8e70-8e46f23fa066', 'volume_size': 1} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:42 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-777bf02a-85b8-4b70-b4d9-93eb96beb7fc" returned: 0 in 0.350s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.043s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2142664244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68765115-991e-40da-b912-b8e76d1537ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad74210e3b154cfaae8409585ab92055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:27:41Z,use_quota=True,user_id='35bf0a206a824d0680e6923b93c4bbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Creating volume 68765115-991e-40da-b912-b8e76d1537ce {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:27:42 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-68765115-991e-40da-b912-b8e76d1537ce 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb16d7a2-72d9-4f8d-9394-7f1e5f79e0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-777bf02a-85b8-4b70-b4d9-93eb96beb7fc', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:42 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-68765115-991e-40da-b912-b8e76d1537ce 1073741824 Nov 03 13:27:42 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57ed30fd-5a80-4426-a1c4-62f810563fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:42 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] Volume volume-777bf02a-85b8-4b70-b4d9-93eb96beb7fc (777bf02a-85b8-4b70-b4d9-93eb96beb7fc): created successfully Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57ed30fd-5a80-4426-a1c4-62f810563fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] Flow 'volume_create_manager' (27f5e80a-afdc-4f93-bc8a-636ba9226c1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:27:42 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-38e50f0f-6d47-4c39-8189-dae1fd35a71b tempest-CreateVolumesFromImageTest-947949362 None] Created volume successfully. Nov 03 13:27:43 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:27:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] Flow 'volume_create_manager' (ff34b277-dfe0-4f71-95b4-f3fee4b6af4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:27:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (295d5a00-7b5c-4d14-ac95-3903925ed4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (295d5a00-7b5c-4d14-ac95-3903925ed4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-933482285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aa9d439-4b25-4e2e-8fbf-9f6b153bab31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fa2e70a52f84acd9a32dfb40a60e2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:27:43Z,use_quota=True,user_id='487b665e8e2e482c905a3edf167cde15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c8e1374-7d9e-4c72-a826-05b18a46186d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c8e1374-7d9e-4c72-a826-05b18a46186d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e36f3e-6da5-4aa3-bae4-e0b6d20986bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e36f3e-6da5-4aa3-bae4-e0b6d20986bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aa9d439-4b25-4e2e-8fbf-9f6b153bab31', 'volume_name': 'volume-1aa9d439-4b25-4e2e-8fbf-9f6b153bab31', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0ded704-c341-4fd5-a9a9-aaac9506c9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0ded704-c341-4fd5-a9a9-aaac9506c9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d18c6c-43ff-415a-b7e6-6b9a6a4824b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:43 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] Volume 1aa9d439-4b25-4e2e-8fbf-9f6b153bab31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aa9d439-4b25-4e2e-8fbf-9f6b153bab31', 'volume_size': 1} Nov 03 13:27:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:43 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-68765115-991e-40da-b912-b8e76d1537ce 1073741824" returned: 0 in 0.513s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-68765115-991e-40da-b912-b8e76d1537ce {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:43 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-68765115-991e-40da-b912-b8e76d1537ce Nov 03 13:27:43 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:43 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-68765115-991e-40da-b912-b8e76d1537ce" returned: 0 in 0.257s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:43 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:27:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.670s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:43 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-831305816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=250c8842-9359-434c-8fbb-fbfb4bd3382c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fa2e70a52f84acd9a32dfb40a60e2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:27:42Z,use_quota=True,user_id='487b665e8e2e482c905a3edf167cde15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:27:43 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] Creating volume 250c8842-9359-434c-8fbb-fbfb4bd3382c {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:27:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:43 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:27:43 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:27:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:43 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:27:43 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:27:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-250c8842-9359-434c-8fbb-fbfb4bd3382c 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ce9bde9-37bf-4d9b-99b3-f31ec2b31657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68765115-991e-40da-b912-b8e76d1537ce', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:43 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-250c8842-9359-434c-8fbb-fbfb4bd3382c 1073741824 Nov 03 13:27:43 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52bdb384-5d1e-43f4-b691-ee3d6caba941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:43 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Volume volume-68765115-991e-40da-b912-b8e76d1537ce (68765115-991e-40da-b912-b8e76d1537ce): created successfully Nov 03 13:27:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52bdb384-5d1e-43f4-b691-ee3d6caba941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:43 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Flow 'volume_create_manager' (2c602b2a-4852-4d2d-8503-bcb660715430) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:27:43 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-ab5d6549-2679-4c7e-b1c7-d0e99ca5d976 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Created volume successfully. Nov 03 13:27:44 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-250c8842-9359-434c-8fbb-fbfb4bd3382c 1073741824" returned: 0 in 0.472s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-250c8842-9359-434c-8fbb-fbfb4bd3382c {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:44 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-250c8842-9359-434c-8fbb-fbfb4bd3382c Nov 03 13:27:44 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:44 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-250c8842-9359-434c-8fbb-fbfb4bd3382c" returned: 0 in 0.249s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:27:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.039s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2023323993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ed0551-ac41-4162-83b3-09f7624dfe78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88025e4dcbe64d47b569aae85e963d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:27:42Z,use_quota=True,user_id='989d3c641bf845bfa8dac174b4e1b4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:27:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] Creating volume 62ed0551-ac41-4162-83b3-09f7624dfe78 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:27:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:27:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:27:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:44 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:27:44 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:27:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d54f46-6c29-4231-bf4f-cf88b0dbc921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-250c8842-9359-434c-8fbb-fbfb4bd3382c', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:44 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78 1073741824 Nov 03 13:27:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d2def2-193a-43f9-be3b-4797f470647f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:44 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:44 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] Volume volume-250c8842-9359-434c-8fbb-fbfb4bd3382c (250c8842-9359-434c-8fbb-fbfb4bd3382c): created successfully Nov 03 13:27:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d2def2-193a-43f9-be3b-4797f470647f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] Flow 'volume_create_manager' (664790c5-ed0a-4b33-8272-4b06a7ad42c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:27:44 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-06fa5252-e4b8-42fc-8622-aa7214297950 tempest-CreateVolumesFromImageTest-947949362 None] Created volume successfully. Nov 03 13:27:44 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78 1073741824" returned: 0 in 0.526s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:45 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78 Nov 03 13:27:45 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:27:45 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Flow 'volume_create_manager' (99a66483-1166-4c5b-b250-5fe33535234e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba26b25-ab06-42cc-a188-9b78124e5505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78" returned: 0 in 0.323s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.781s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1425177213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c780359-d0fa-4d2a-bc88-22bc57451f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fa2e70a52f84acd9a32dfb40a60e2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:27:42Z,use_quota=True,user_id='487b665e8e2e482c905a3edf167cde15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] Creating volume 0c780359-d0fa-4d2a-bc88-22bc57451f90 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:27:45 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0c780359-d0fa-4d2a-bc88-22bc57451f90 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba26b25-ab06-42cc-a188-9b78124e5505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2127250489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1b0b641-8776-40ce-9420-a9f5eb5879f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad74210e3b154cfaae8409585ab92055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:27:45Z,use_quota=True,user_id='35bf0a206a824d0680e6923b93c4bbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7d65f62-ea26-47e8-a26e-21d0409861a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:45 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0c780359-d0fa-4d2a-bc88-22bc57451f90 1073741824 Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7d65f62-ea26-47e8-a26e-21d0409861a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:45 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e9a6a9f-f2f3-4c3e-9f6d-6b32f4b6cbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e9a6a9f-f2f3-4c3e-9f6d-6b32f4b6cbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1b0b641-8776-40ce-9420-a9f5eb5879f8', 'volume_name': 'volume-f1b0b641-8776-40ce-9420-a9f5eb5879f8', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5782a69b-a3af-433a-8e7b-db98906bd532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5782a69b-a3af-433a-8e7b-db98906bd532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21069f5c-dbd2-4de2-959d-18955592a6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:45 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Volume f1b0b641-8776-40ce-9420-a9f5eb5879f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1b0b641-8776-40ce-9420-a9f5eb5879f8', 'volume_size': 1} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0a356cb-4820-451e-97b7-6186a68aae76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62ed0551-ac41-4162-83b3-09f7624dfe78', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd38dee3-9643-48b5-91c2-9dd09679072c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:45 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] Volume volume-62ed0551-ac41-4162-83b3-09f7624dfe78 (62ed0551-ac41-4162-83b3-09f7624dfe78): created successfully Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd38dee3-9643-48b5-91c2-9dd09679072c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] Flow 'volume_create_manager' (03bf3f6f-587c-4da9-bf5f-0b1023c61110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:27:45 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-0e790d6f-2b29-4cfe-b165-cd0dcac6eb8b tempest-VolumeDependencyTests-154917658 None] Created volume successfully. Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Flow 'volume_create_manager' (00ebb6fd-d888-4fbb-9c53-02b8e702edd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2147ea4-af94-4cf8-ba33-0bb0efe8d65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2147ea4-af94-4cf8-ba33-0bb0efe8d65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0616308e-3ebf-47d2-a252-fa1ff5518f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df162eaec22a46d9b3325566de0db19b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:27:46Z,use_quota=True,user_id='649fc4fd7fd74a8c8d842be354d7afd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89ff70cd-e7be-406c-9d27-e8f3dc547da3),volume_type_id=89ff70cd-e7be-406c-9d27-e8f3dc547da3)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c82d620a-7935-4585-b5f6-db1b7f5b2d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c82d620a-7935-4585-b5f6-db1b7f5b2d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c6b5821-a7c9-4a52-b330-0f4bf7b9f187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.image.glance [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Creating Keystone auth plugin from conf {{(pid=86725) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Flow 'volume_create_manager' (069e8660-b64c-4ef2-9fc4-10a11c99f950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcb65242-8d82-4d5b-ac8c-91c767806618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcb65242-8d82-4d5b-ac8c-91c767806618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1234563895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158ee86c-8aab-4dc8-ba3c-3ac0c19ca4b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad74210e3b154cfaae8409585ab92055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:27:46Z,use_quota=True,user_id='35bf0a206a824d0680e6923b93c4bbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf477e87-6f91-4fc9-8cd0-60e4221199cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf477e87-6f91-4fc9-8cd0-60e4221199cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b417b7-ab2c-4ea7-8a44-c51173850888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b417b7-ab2c-4ea7-8a44-c51173850888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '158ee86c-8aab-4dc8-ba3c-3ac0c19ca4b3', 'volume_name': 'volume-158ee86c-8aab-4dc8-ba3c-3ac0c19ca4b3', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff4294ad-40ad-4801-8f84-7b0efe238e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff4294ad-40ad-4801-8f84-7b0efe238e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c83376d-1211-431d-9d20-a040d8e41177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:46 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Volume 158ee86c-8aab-4dc8-ba3c-3ac0c19ca4b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-158ee86c-8aab-4dc8-ba3c-3ac0c19ca4b3', 'volume_size': 1} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:46 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0c780359-d0fa-4d2a-bc88-22bc57451f90 1073741824" returned: 0 in 0.659s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0c780359-d0fa-4d2a-bc88-22bc57451f90 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:46 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0c780359-d0fa-4d2a-bc88-22bc57451f90 Nov 03 13:27:46 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Flow 'volume_create_manager' (2b948c00-eadd-42f3-b83b-d0baf211214f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (505146ee-3ca1-461e-b418-b7685730e087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (505146ee-3ca1-461e-b418-b7685730e087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-971498651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf3f1a3-4d56-4321-801a-9d52da0ef5b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad74210e3b154cfaae8409585ab92055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:27:46Z,use_quota=True,user_id='35bf0a206a824d0680e6923b93c4bbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da17834d-ece4-41e1-970d-c0ef73059b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da17834d-ece4-41e1-970d-c0ef73059b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (842c3177-03d9-4b4d-8863-cbf65e4ca482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (842c3177-03d9-4b4d-8863-cbf65e4ca482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cf3f1a3-4d56-4321-801a-9d52da0ef5b6', 'volume_name': 'volume-0cf3f1a3-4d56-4321-801a-9d52da0ef5b6', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc8f4ef-a282-4978-9856-b53804fdb778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc8f4ef-a282-4978-9856-b53804fdb778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1a4628-9c65-4206-a8fc-aba8573894f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:46 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Volume 0cf3f1a3-4d56-4321-801a-9d52da0ef5b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cf3f1a3-4d56-4321-801a-9d52da0ef5b6', 'volume_size': 1} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c6b5821-a7c9-4a52-b330-0f4bf7b9f187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0616308e-3ebf-47d2-a252-fa1ff5518f3d', 'volume_name': 'volume-0616308e-3ebf-47d2-a252-fa1ff5518f3d', 'volume_size': 1, 'image_id': 'cfb459a7-43df-479a-a144-b8ed375d1cf6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cfb459a7-43df-479a-a144-b8ed375d1cf6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '404622b69f06e2a53d2dce805847f51c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'df162eaec22a46d9b3325566de0db19b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a40360518673fc0372f309622d8e259f00a40a83e10cd0096b7cdcaf9cca4df413af6eb0cda560b4a63cce35f46c90d299fd2bf9737d108dea46789fd2c61ff', 'id': 'cfb459a7-43df-479a-a144-b8ed375d1cf6', 'created_at': datetime.datetime(2026, 11, 3, 12, 27, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 27, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cfb459a7-43df-479a-a144-b8ed375d1cf6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01938663-1a96-4c29-abf1-822471f81d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01938663-1a96-4c29-abf1-822471f81d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (478f22f9-7d7d-42dd-93da-b054752fe071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:46 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Volume 0616308e-3ebf-47d2-a252-fa1ff5518f3d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0616308e-3ebf-47d2-a252-fa1ff5518f3d', 'volume_size': 1, 'image_id': 'cfb459a7-43df-479a-a144-b8ed375d1cf6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cfb459a7-43df-479a-a144-b8ed375d1cf6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '404622b69f06e2a53d2dce805847f51c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'df162eaec22a46d9b3325566de0db19b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a40360518673fc0372f309622d8e259f00a40a83e10cd0096b7cdcaf9cca4df413af6eb0cda560b4a63cce35f46c90d299fd2bf9737d108dea46789fd2c61ff', 'id': 'cfb459a7-43df-479a-a144-b8ed375d1cf6', 'created_at': datetime.datetime(2026, 11, 3, 12, 27, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 27, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cfb459a7-43df-479a-a144-b8ed375d1cf6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Trying to clone 0616308e-3ebf-47d2-a252-fa1ff5518f3d from image cfb459a7-43df-479a-a144-b8ed375d1cf6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cfb459a7-43df-479a-a144-b8ed375d1cf6', 'metadata': {}}]). {{(pid=86725) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 13:27:46 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0c780359-d0fa-4d2a-bc88-22bc57451f90" returned: 0 in 0.341s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.608s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1067988381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e1e6ede-5dd7-4e43-8e70-8e46f23fa066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fa2e70a52f84acd9a32dfb40a60e2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:27:43Z,use_quota=True,user_id='487b665e8e2e482c905a3edf167cde15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] Creating volume 1e1e6ede-5dd7-4e43-8e70-8e46f23fa066 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:27:46 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1e1e6ede-5dd7-4e43-8e70-8e46f23fa066 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:46 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1e1e6ede-5dd7-4e43-8e70-8e46f23fa066 1073741824 Nov 03 13:27:46 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5086473a-581e-455b-a6de-571064bc6830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c780359-d0fa-4d2a-bc88-22bc57451f90', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624e2279-240c-4685-9ffa-771a94f21a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cfb459a7-43df-479a-a144-b8ed375d1cf6_a1mkvndudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86725) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 13:27:46 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Image download 0.00 MB at 0.00 MB/s Nov 03 13:27:46 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] Volume volume-0c780359-d0fa-4d2a-bc88-22bc57451f90 (0c780359-d0fa-4d2a-bc88-22bc57451f90): created successfully Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624e2279-240c-4685-9ffa-771a94f21a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] Flow 'volume_create_manager' (f28a03c9-46fc-4184-9b98-4b024a69c9d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1e24fc-deed-4164-ae07-1501ba02098a]: (4, 'raw') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:27:46 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-fad647f0-0f25-43bd-bf96-579574689bdd tempest-CreateVolumesFromImageTest-947949362 None] Created volume successfully. Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfb459a7-43df-479a-a144-b8ed375d1cf6_a1mkvndudevstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Flow 'volume_create_manager' (f99e7379-ffbb-480f-82b3-b1e1ba9bf811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78623968-5c75-4d49-b1b6-68d758baa573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78623968-5c75-4d49-b1b6-68d758baa573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1011062825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7df21b7-53a7-46af-9acf-9e2d210cbbd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad74210e3b154cfaae8409585ab92055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:27:47Z,use_quota=True,user_id='35bf0a206a824d0680e6923b93c4bbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57503743-874e-43c1-8db3-f75d086d9e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57503743-874e-43c1-8db3-f75d086d9e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3b1b482-1d72-47b0-8f33-85feb42fc974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3b1b482-1d72-47b0-8f33-85feb42fc974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7df21b7-53a7-46af-9acf-9e2d210cbbd8', 'volume_name': 'volume-c7df21b7-53a7-46af-9acf-9e2d210cbbd8', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f6f1b08-faa4-429d-adf1-d16e551de255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:46 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfb459a7-43df-479a-a144-b8ed375d1cf6_a1mkvndudevstack@QuobyteHD Nov 03 13:27:46 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f6f1b08-faa4-429d-adf1-d16e551de255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaa214d3-123f-465f-86d6-173a6e1f0afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:46 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Volume c7df21b7-53a7-46af-9acf-9e2d210cbbd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7df21b7-53a7-46af-9acf-9e2d210cbbd8', 'volume_size': 1} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-886057cc-d8f4-477c-af34-ac3037a48b51 tempest-VolumeDependencyTests-154917658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:47 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:47 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1e1e6ede-5dd7-4e43-8e70-8e46f23fa066 1073741824" returned: 0 in 0.678s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfb459a7-43df-479a-a144-b8ed375d1cf6_a1mkvndudevstack@QuobyteHD" returned: 0 in 0.492s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfb459a7-43df-479a-a144-b8ed375d1cf6_a1mkvndudevstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1e1e6ede-5dd7-4e43-8e70-8e46f23fa066 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:47 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1e1e6ede-5dd7-4e43-8e70-8e46f23fa066 Nov 03 13:27:47 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Flow 'volume_create_manager' (fe606ab5-77ba-4e75-ab78-1692674d5dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:27:47 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfb459a7-43df-479a-a144-b8ed375d1cf6_a1mkvndudevstack@QuobyteHD Nov 03 13:27:47 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c7d9270-1076-412c-b330-098619752df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c7d9270-1076-412c-b330-098619752df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1189127688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36cf4e84-f563-4023-8910-c9f3301cc0b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad74210e3b154cfaae8409585ab92055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:27:47Z,use_quota=True,user_id='35bf0a206a824d0680e6923b93c4bbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5886b6a4-e7af-4e8d-b40d-9f97f6e38293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5886b6a4-e7af-4e8d-b40d-9f97f6e38293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acf6b051-c048-402e-ac70-9521d196a8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acf6b051-c048-402e-ac70-9521d196a8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36cf4e84-f563-4023-8910-c9f3301cc0b5', 'volume_name': 'volume-36cf4e84-f563-4023-8910-c9f3301cc0b5', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd30c9e8-2b62-421c-94a9-237de3c3c628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd30c9e8-2b62-421c-94a9-237de3c3c628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29aad0c9-7d7c-4ae6-a6dd-b4802269c793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:47 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Volume 36cf4e84-f563-4023-8910-c9f3301cc0b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36cf4e84-f563-4023-8910-c9f3301cc0b5', 'volume_size': 1} Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:47 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1e1e6ede-5dd7-4e43-8e70-8e46f23fa066" returned: 0 in 0.278s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.167s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-933482285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aa9d439-4b25-4e2e-8fbf-9f6b153bab31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fa2e70a52f84acd9a32dfb40a60e2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:27:43Z,use_quota=True,user_id='487b665e8e2e482c905a3edf167cde15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] Creating volume 1aa9d439-4b25-4e2e-8fbf-9f6b153bab31 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:27:47 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1aa9d439-4b25-4e2e-8fbf-9f6b153bab31 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:47 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfb459a7-43df-479a-a144-b8ed375d1cf6_a1mkvndudevstack@QuobyteHD" returned: 1 in 0.359s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfb459a7-43df-479a-a144-b8ed375d1cf6_a1mkvndudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Temporary image cfb459a7-43df-479a-a144-b8ed375d1cf6 is fetched for user 649fc4fd7fd74a8c8d842be354d7afd0. {{(pid=86725) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 13:27:47 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1aa9d439-4b25-4e2e-8fbf-9f6b153bab31 1073741824 Nov 03 13:27:47 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be147c73-6ad2-43b5-a695-91ee50bc2300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e1e6ede-5dd7-4e43-8e70-8e46f23fa066', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb14cfe0-176f-499b-899d-e4f4cf68e8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:47 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] Volume volume-1e1e6ede-5dd7-4e43-8e70-8e46f23fa066 (1e1e6ede-5dd7-4e43-8e70-8e46f23fa066): created successfully Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb14cfe0-176f-499b-899d-e4f4cf68e8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] Flow 'volume_create_manager' (4d47122a-b185-4d69-afc7-d01488550692) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:27:47 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-b6fb1f42-fc1c-4c4b-8433-c9632758e5a1 tempest-CreateVolumesFromImageTest-947949362 None] Created volume successfully. Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ccaad5-aee5-41ec-9ea3-5c9c6537c31d]: (4, 'raw') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfb459a7-43df-479a-a144-b8ed375d1cf6_a1mkvndudevstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:47 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfb459a7-43df-479a-a144-b8ed375d1cf6_a1mkvndudevstack@QuobyteHD Nov 03 13:27:47 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:47 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfb459a7-43df-479a-a144-b8ed375d1cf6_a1mkvndudevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfb459a7-43df-479a-a144-b8ed375d1cf6_a1mkvndudevstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:47 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1aa9d439-4b25-4e2e-8fbf-9f6b153bab31 1073741824" returned: 0 in 0.460s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1aa9d439-4b25-4e2e-8fbf-9f6b153bab31 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:48 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1aa9d439-4b25-4e2e-8fbf-9f6b153bab31 Nov 03 13:27:48 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:48 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfb459a7-43df-479a-a144-b8ed375d1cf6_a1mkvndudevstack@QuobyteHD Nov 03 13:27:48 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:48 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1aa9d439-4b25-4e2e-8fbf-9f6b153bab31" returned: 0 in 0.256s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.780s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2127250489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1b0b641-8776-40ce-9420-a9f5eb5879f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad74210e3b154cfaae8409585ab92055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:27:45Z,use_quota=True,user_id='35bf0a206a824d0680e6923b93c4bbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Creating volume f1b0b641-8776-40ce-9420-a9f5eb5879f8 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:27:48 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f1b0b641-8776-40ce-9420-a9f5eb5879f8 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:48 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d18c6c-43ff-415a-b7e6-6b9a6a4824b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aa9d439-4b25-4e2e-8fbf-9f6b153bab31', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:48 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f1b0b641-8776-40ce-9420-a9f5eb5879f8 1073741824 Nov 03 13:27:48 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1602a9b-d83a-4b51-b941-516f7ed18cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfb459a7-43df-479a-a144-b8ed375d1cf6_a1mkvndudevstack@QuobyteHD" returned: 1 in 0.361s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfb459a7-43df-479a-a144-b8ed375d1cf6_a1mkvndudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:48 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] Volume volume-1aa9d439-4b25-4e2e-8fbf-9f6b153bab31 (1aa9d439-4b25-4e2e-8fbf-9f6b153bab31): created successfully Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1602a9b-d83a-4b51-b941-516f7ed18cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] Flow 'volume_create_manager' (ff34b277-dfe0-4f71-95b4-f3fee4b6af4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:27:48 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-5800d9e1-f8d6-4a33-9dc5-487f34fa7fa2 tempest-CreateVolumesFromImageTest-947949362 None] Created volume successfully. Nov 03 13:27:48 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f1b0b641-8776-40ce-9420-a9f5eb5879f8 1073741824" returned: 0 in 0.406s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f1b0b641-8776-40ce-9420-a9f5eb5879f8 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:48 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f1b0b641-8776-40ce-9420-a9f5eb5879f8 Nov 03 13:27:48 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:48 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f1b0b641-8776-40ce-9420-a9f5eb5879f8" returned: 0 in 0.240s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.923s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1234563895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158ee86c-8aab-4dc8-ba3c-3ac0c19ca4b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad74210e3b154cfaae8409585ab92055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:27:46Z,use_quota=True,user_id='35bf0a206a824d0680e6923b93c4bbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Creating volume 158ee86c-8aab-4dc8-ba3c-3ac0c19ca4b3 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:27:48 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-158ee86c-8aab-4dc8-ba3c-3ac0c19ca4b3 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21069f5c-dbd2-4de2-959d-18955592a6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1b0b641-8776-40ce-9420-a9f5eb5879f8', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:48 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-158ee86c-8aab-4dc8-ba3c-3ac0c19ca4b3 1073741824 Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f82394a5-70f5-4416-b82f-1c8b2218873f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:48 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:48 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Volume volume-f1b0b641-8776-40ce-9420-a9f5eb5879f8 (f1b0b641-8776-40ce-9420-a9f5eb5879f8): created successfully Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f82394a5-70f5-4416-b82f-1c8b2218873f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:48 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Flow 'volume_create_manager' (99a66483-1166-4c5b-b250-5fe33535234e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:27:49 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-3c3ec73d-7d92-4095-af5f-e1b15e5e91b1 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Created volume successfully. Nov 03 13:27:49 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-639efd15-29d3-45c1-9072-9b126d3ba911 tempest-CreateVolumesFromImageTest-947949362 None] Acquiring lock "cinder-1aa9d439-4b25-4e2e-8fbf-9f6b153bab31-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:27:49 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-639efd15-29d3-45c1-9072-9b126d3ba911 tempest-CreateVolumesFromImageTest-947949362 None] Lock "cinder-1aa9d439-4b25-4e2e-8fbf-9f6b153bab31-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:27:49 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-639efd15-29d3-45c1-9072-9b126d3ba911 tempest-CreateVolumesFromImageTest-947949362 None] Acquiring lock "cinder-quobyte-1aa9d439-4b25-4e2e-8fbf-9f6b153bab31" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:27:49 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-639efd15-29d3-45c1-9072-9b126d3ba911 tempest-CreateVolumesFromImageTest-947949362 None] Lock "cinder-quobyte-1aa9d439-4b25-4e2e-8fbf-9f6b153bab31" acquired by "delete_volume" :: waited 0.016s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:27:49 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e42ba84-d301-452e-aa8f-3b902ad944e9]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:27:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-639efd15-29d3-45c1-9072-9b126d3ba911 tempest-CreateVolumesFromImageTest-947949362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1aa9d439-4b25-4e2e-8fbf-9f6b153bab31 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:49 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1aa9d439-4b25-4e2e-8fbf-9f6b153bab31 Nov 03 13:27:49 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:49 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-158ee86c-8aab-4dc8-ba3c-3ac0c19ca4b3 1073741824" returned: 0 in 0.502s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-158ee86c-8aab-4dc8-ba3c-3ac0c19ca4b3 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:49 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-158ee86c-8aab-4dc8-ba3c-3ac0c19ca4b3 Nov 03 13:27:49 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:49 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-639efd15-29d3-45c1-9072-9b126d3ba911 tempest-CreateVolumesFromImageTest-947949362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1aa9d439-4b25-4e2e-8fbf-9f6b153bab31" returned: 0 in 0.388s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-639efd15-29d3-45c1-9072-9b126d3ba911 tempest-CreateVolumesFromImageTest-947949362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1aa9d439-4b25-4e2e-8fbf-9f6b153bab31 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:49 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1aa9d439-4b25-4e2e-8fbf-9f6b153bab31 Nov 03 13:27:49 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:49 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-158ee86c-8aab-4dc8-ba3c-3ac0c19ca4b3" returned: 0 in 0.247s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:27:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.468s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-971498651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf3f1a3-4d56-4321-801a-9d52da0ef5b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad74210e3b154cfaae8409585ab92055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:27:46Z,use_quota=True,user_id='35bf0a206a824d0680e6923b93c4bbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:27:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Creating volume 0cf3f1a3-4d56-4321-801a-9d52da0ef5b6 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:27:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:27:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:27:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:49 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:27:49 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:27:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0cf3f1a3-4d56-4321-801a-9d52da0ef5b6 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:49 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0cf3f1a3-4d56-4321-801a-9d52da0ef5b6 1073741824 Nov 03 13:27:49 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c83376d-1211-431d-9d20-a040d8e41177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-158ee86c-8aab-4dc8-ba3c-3ac0c19ca4b3', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a018517f-3023-46b4-84c9-65b30d4ab0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:49 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Volume volume-158ee86c-8aab-4dc8-ba3c-3ac0c19ca4b3 (158ee86c-8aab-4dc8-ba3c-3ac0c19ca4b3): created successfully Nov 03 13:27:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a018517f-3023-46b4-84c9-65b30d4ab0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:49 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Flow 'volume_create_manager' (069e8660-b64c-4ef2-9fc4-10a11c99f950) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:27:49 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-0e05ec38-20d2-4081-84d2-ef678400d27a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Created volume successfully. Nov 03 13:27:49 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-639efd15-29d3-45c1-9072-9b126d3ba911 tempest-CreateVolumesFromImageTest-947949362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1aa9d439-4b25-4e2e-8fbf-9f6b153bab31" returned: 0 in 0.270s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:49 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-639efd15-29d3-45c1-9072-9b126d3ba911 tempest-CreateVolumesFromImageTest-947949362 None] Lock "cinder-quobyte-1aa9d439-4b25-4e2e-8fbf-9f6b153bab31" released by "delete_volume" :: held 0.716s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-639efd15-29d3-45c1-9072-9b126d3ba911 tempest-CreateVolumesFromImageTest-947949362 None] Created reservations ['4f81f365-e056-42e8-b7a6-69cb72b74c1b', '10d1e9f0-d79c-48d1-be5e-adbf7c77aad2', '896a8202-8da7-4037-9f7f-d2dbccb6bac3', '77b10435-8735-4417-9c00-daa140b79a01'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-639efd15-29d3-45c1-9072-9b126d3ba911 tempest-CreateVolumesFromImageTest-947949362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-639efd15-29d3-45c1-9072-9b126d3ba911 tempest-CreateVolumesFromImageTest-947949362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-639efd15-29d3-45c1-9072-9b126d3ba911 tempest-CreateVolumesFromImageTest-947949362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-639efd15-29d3-45c1-9072-9b126d3ba911 tempest-CreateVolumesFromImageTest-947949362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-639efd15-29d3-45c1-9072-9b126d3ba911 tempest-CreateVolumesFromImageTest-947949362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-639efd15-29d3-45c1-9072-9b126d3ba911 tempest-CreateVolumesFromImageTest-947949362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:50 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:27:50 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:50 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0cf3f1a3-4d56-4321-801a-9d52da0ef5b6 1073741824" returned: 0 in 0.470s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0cf3f1a3-4d56-4321-801a-9d52da0ef5b6 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:50 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0cf3f1a3-4d56-4321-801a-9d52da0ef5b6 Nov 03 13:27:50 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:50 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-94eab6e1-0c91-485c-8259-aa96d10feacc tempest-CreateVolumesFromImageTest-947949362 None] Acquiring lock "cinder-1e1e6ede-5dd7-4e43-8e70-8e46f23fa066-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-639efd15-29d3-45c1-9072-9b126d3ba911 tempest-CreateVolumesFromImageTest-947949362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.314s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-639efd15-29d3-45c1-9072-9b126d3ba911 tempest-CreateVolumesFromImageTest-947949362 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:27:50 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-639efd15-29d3-45c1-9072-9b126d3ba911 tempest-CreateVolumesFromImageTest-947949362 None] Deleted volume successfully. Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-94eab6e1-0c91-485c-8259-aa96d10feacc tempest-CreateVolumesFromImageTest-947949362 None] Lock "cinder-1e1e6ede-5dd7-4e43-8e70-8e46f23fa066-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-639efd15-29d3-45c1-9072-9b126d3ba911 tempest-CreateVolumesFromImageTest-947949362 None] Lock "cinder-1aa9d439-4b25-4e2e-8fbf-9f6b153bab31-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-94eab6e1-0c91-485c-8259-aa96d10feacc tempest-CreateVolumesFromImageTest-947949362 None] Acquiring lock "cinder-quobyte-1e1e6ede-5dd7-4e43-8e70-8e46f23fa066" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-94eab6e1-0c91-485c-8259-aa96d10feacc tempest-CreateVolumesFromImageTest-947949362 None] Lock "cinder-quobyte-1e1e6ede-5dd7-4e43-8e70-8e46f23fa066" acquired by "delete_volume" :: waited 0.015s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a9a11e-ed0d-4b4c-9de4-737f1b7dfc33]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-94eab6e1-0c91-485c-8259-aa96d10feacc tempest-CreateVolumesFromImageTest-947949362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1e1e6ede-5dd7-4e43-8e70-8e46f23fa066 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:50 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0cf3f1a3-4d56-4321-801a-9d52da0ef5b6" returned: 0 in 0.312s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.690s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1011062825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7df21b7-53a7-46af-9acf-9e2d210cbbd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad74210e3b154cfaae8409585ab92055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:27:47Z,use_quota=True,user_id='35bf0a206a824d0680e6923b93c4bbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Creating volume c7df21b7-53a7-46af-9acf-9e2d210cbbd8 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:27:50 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c7df21b7-53a7-46af-9acf-9e2d210cbbd8 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:50 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c7df21b7-53a7-46af-9acf-9e2d210cbbd8 1073741824 Nov 03 13:27:50 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1a4628-9c65-4206-a8fc-aba8573894f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cf3f1a3-4d56-4321-801a-9d52da0ef5b6', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a3e92b-8b31-4793-87e5-aacd48f161e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:50 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Volume volume-0cf3f1a3-4d56-4321-801a-9d52da0ef5b6 (0cf3f1a3-4d56-4321-801a-9d52da0ef5b6): created successfully Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a3e92b-8b31-4793-87e5-aacd48f161e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Flow 'volume_create_manager' (2b948c00-eadd-42f3-b83b-d0baf211214f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:27:50 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1e1e6ede-5dd7-4e43-8e70-8e46f23fa066 Nov 03 13:27:50 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:50 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-0e7b6459-ee11-46df-bdc7-622985a847bb tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Created volume successfully. Nov 03 13:27:50 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-94eab6e1-0c91-485c-8259-aa96d10feacc tempest-CreateVolumesFromImageTest-947949362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1e1e6ede-5dd7-4e43-8e70-8e46f23fa066" returned: 0 in 0.377s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-94eab6e1-0c91-485c-8259-aa96d10feacc tempest-CreateVolumesFromImageTest-947949362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1e1e6ede-5dd7-4e43-8e70-8e46f23fa066 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:50 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1e1e6ede-5dd7-4e43-8e70-8e46f23fa066 Nov 03 13:27:50 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:51 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c7df21b7-53a7-46af-9acf-9e2d210cbbd8 1073741824" returned: 0 in 0.465s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c7df21b7-53a7-46af-9acf-9e2d210cbbd8 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:51 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c7df21b7-53a7-46af-9acf-9e2d210cbbd8 Nov 03 13:27:51 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:51 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-94eab6e1-0c91-485c-8259-aa96d10feacc tempest-CreateVolumesFromImageTest-947949362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1e1e6ede-5dd7-4e43-8e70-8e46f23fa066" returned: 0 in 0.267s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-94eab6e1-0c91-485c-8259-aa96d10feacc tempest-CreateVolumesFromImageTest-947949362 None] Lock "cinder-quobyte-1e1e6ede-5dd7-4e43-8e70-8e46f23fa066" released by "delete_volume" :: held 0.687s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:27:51 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-94eab6e1-0c91-485c-8259-aa96d10feacc tempest-CreateVolumesFromImageTest-947949362 None] Created reservations ['247128f8-286d-4470-8b72-e6b9707c436e', '3305c43a-0d70-4f48-a622-b6df1d6f8447', '2fa66fbf-7dc2-43fb-a1d4-6e2df4983e97', '826b0e24-7a4e-4bfa-b4ee-b4f78aefafc4'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:27:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-94eab6e1-0c91-485c-8259-aa96d10feacc tempest-CreateVolumesFromImageTest-947949362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-94eab6e1-0c91-485c-8259-aa96d10feacc tempest-CreateVolumesFromImageTest-947949362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-94eab6e1-0c91-485c-8259-aa96d10feacc tempest-CreateVolumesFromImageTest-947949362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:27:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-94eab6e1-0c91-485c-8259-aa96d10feacc tempest-CreateVolumesFromImageTest-947949362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:27:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-94eab6e1-0c91-485c-8259-aa96d10feacc tempest-CreateVolumesFromImageTest-947949362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-94eab6e1-0c91-485c-8259-aa96d10feacc tempest-CreateVolumesFromImageTest-947949362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:51 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:27:51 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:51 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c7df21b7-53a7-46af-9acf-9e2d210cbbd8" returned: 0 in 0.277s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:27:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-886057cc-d8f4-477c-af34-ac3037a48b51 tempest-VolumeDependencyTests-154917658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.459s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaa214d3-123f-465f-86d6-173a6e1f0afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7df21b7-53a7-46af-9acf-9e2d210cbbd8', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b084ad-ae06-41e7-ae6b-c906bc6c2fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-886057cc-d8f4-477c-af34-ac3037a48b51 tempest-VolumeDependencyTests-154917658 None] Creating offline snapshot 786be806-ad9f-46e9-9cb9-571641abccb6 of volume 62ed0551-ac41-4162-83b3-09f7624dfe78 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:27:51 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Volume volume-c7df21b7-53a7-46af-9acf-9e2d210cbbd8 (c7df21b7-53a7-46af-9acf-9e2d210cbbd8): created successfully Nov 03 13:27:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b084ad-ae06-41e7-ae6b-c906bc6c2fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Flow 'volume_create_manager' (f99e7379-ffbb-480f-82b3-b1e1ba9bf811) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:27:51 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[480ba52a-d235-41b9-85ad-90ca6e3710ef]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:27:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-886057cc-d8f4-477c-af34-ac3037a48b51 tempest-VolumeDependencyTests-154917658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:51 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-7b4bf90b-4888-4610-b2a0-6c5749d3b501 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Created volume successfully. Nov 03 13:27:51 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78 Nov 03 13:27:51 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d1077fdc-c54c-420b-8f65-2dee7e9dcf26 tempest-CreateVolumesFromImageTest-947949362 None] Acquiring lock "cinder-0c780359-d0fa-4d2a-bc88-22bc57451f90-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:27:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d1077fdc-c54c-420b-8f65-2dee7e9dcf26 tempest-CreateVolumesFromImageTest-947949362 None] Lock "cinder-0c780359-d0fa-4d2a-bc88-22bc57451f90-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:27:51 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-94eab6e1-0c91-485c-8259-aa96d10feacc tempest-CreateVolumesFromImageTest-947949362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.348s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:51 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-94eab6e1-0c91-485c-8259-aa96d10feacc tempest-CreateVolumesFromImageTest-947949362 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:27:51 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-94eab6e1-0c91-485c-8259-aa96d10feacc tempest-CreateVolumesFromImageTest-947949362 None] Deleted volume successfully. Nov 03 13:27:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d1077fdc-c54c-420b-8f65-2dee7e9dcf26 tempest-CreateVolumesFromImageTest-947949362 None] Acquiring lock "cinder-quobyte-0c780359-d0fa-4d2a-bc88-22bc57451f90" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:27:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-94eab6e1-0c91-485c-8259-aa96d10feacc tempest-CreateVolumesFromImageTest-947949362 None] Lock "cinder-1e1e6ede-5dd7-4e43-8e70-8e46f23fa066-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:27:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d1077fdc-c54c-420b-8f65-2dee7e9dcf26 tempest-CreateVolumesFromImageTest-947949362 None] Lock "cinder-quobyte-0c780359-d0fa-4d2a-bc88-22bc57451f90" acquired by "delete_volume" :: waited 0.019s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:27:51 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d0aa2c-065a-4fb6-9579-6927a40941b5]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:27:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d1077fdc-c54c-420b-8f65-2dee7e9dcf26 tempest-CreateVolumesFromImageTest-947949362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0c780359-d0fa-4d2a-bc88-22bc57451f90 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:51 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0c780359-d0fa-4d2a-bc88-22bc57451f90 Nov 03 13:27:51 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:51 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-886057cc-d8f4-477c-af34-ac3037a48b51 tempest-VolumeDependencyTests-154917658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78" returned: 0 in 0.496s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-886057cc-d8f4-477c-af34-ac3037a48b51 tempest-VolumeDependencyTests-154917658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78.786be806-ad9f-46e9-9cb9-571641abccb6 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:51 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78.786be806-ad9f-46e9-9cb9-571641abccb6 1G Nov 03 13:27:51 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:52 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d1077fdc-c54c-420b-8f65-2dee7e9dcf26 tempest-CreateVolumesFromImageTest-947949362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0c780359-d0fa-4d2a-bc88-22bc57451f90" returned: 0 in 0.383s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d1077fdc-c54c-420b-8f65-2dee7e9dcf26 tempest-CreateVolumesFromImageTest-947949362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0c780359-d0fa-4d2a-bc88-22bc57451f90 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:52 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0c780359-d0fa-4d2a-bc88-22bc57451f90 Nov 03 13:27:52 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:52 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-886057cc-d8f4-477c-af34-ac3037a48b51 tempest-VolumeDependencyTests-154917658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78.786be806-ad9f-46e9-9cb9-571641abccb6 1G" returned: 0 in 0.429s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-886057cc-d8f4-477c-af34-ac3037a48b51 tempest-VolumeDependencyTests-154917658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62ed0551-ac41-4162-83b3-09f7624dfe78 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78.786be806-ad9f-46e9-9cb9-571641abccb6 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:52 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62ed0551-ac41-4162-83b3-09f7624dfe78 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78.786be806-ad9f-46e9-9cb9-571641abccb6 Nov 03 13:27:52 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:52 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d1077fdc-c54c-420b-8f65-2dee7e9dcf26 tempest-CreateVolumesFromImageTest-947949362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0c780359-d0fa-4d2a-bc88-22bc57451f90" returned: 0 in 0.273s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:52 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d1077fdc-c54c-420b-8f65-2dee7e9dcf26 tempest-CreateVolumesFromImageTest-947949362 None] Lock "cinder-quobyte-0c780359-d0fa-4d2a-bc88-22bc57451f90" released by "delete_volume" :: held 0.710s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:27:52 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-d1077fdc-c54c-420b-8f65-2dee7e9dcf26 tempest-CreateVolumesFromImageTest-947949362 None] Created reservations ['0a1e5efe-62e9-454f-9908-3f6630327240', '3ba4fa8a-36b8-4e6d-b64e-fdaf50bcd196', 'eef11549-d2fa-4665-a6d6-835518edea60', '11552e33-b59b-4780-bc5f-e9cb72c45709'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:27:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d1077fdc-c54c-420b-8f65-2dee7e9dcf26 tempest-CreateVolumesFromImageTest-947949362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d1077fdc-c54c-420b-8f65-2dee7e9dcf26 tempest-CreateVolumesFromImageTest-947949362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:52 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d1077fdc-c54c-420b-8f65-2dee7e9dcf26 tempest-CreateVolumesFromImageTest-947949362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:27:52 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d1077fdc-c54c-420b-8f65-2dee7e9dcf26 tempest-CreateVolumesFromImageTest-947949362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:27:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d1077fdc-c54c-420b-8f65-2dee7e9dcf26 tempest-CreateVolumesFromImageTest-947949362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d1077fdc-c54c-420b-8f65-2dee7e9dcf26 tempest-CreateVolumesFromImageTest-947949362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:52 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:27:52 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:52 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-886057cc-d8f4-477c-af34-ac3037a48b51 tempest-VolumeDependencyTests-154917658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62ed0551-ac41-4162-83b3-09f7624dfe78 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78.786be806-ad9f-46e9-9cb9-571641abccb6" returned: 0 in 0.304s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:52 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-886057cc-d8f4-477c-af34-ac3037a48b51 tempest-VolumeDependencyTests-154917658 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78.786be806-ad9f-46e9-9cb9-571641abccb6 is being set with open permissions: ugo+rw Nov 03 13:27:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-886057cc-d8f4-477c-af34-ac3037a48b51 tempest-VolumeDependencyTests-154917658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78.786be806-ad9f-46e9-9cb9-571641abccb6 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:52 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78.786be806-ad9f-46e9-9cb9-571641abccb6 Nov 03 13:27:52 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:52 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d1077fdc-c54c-420b-8f65-2dee7e9dcf26 tempest-CreateVolumesFromImageTest-947949362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.274s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:52 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-d1077fdc-c54c-420b-8f65-2dee7e9dcf26 tempest-CreateVolumesFromImageTest-947949362 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:27:52 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-d1077fdc-c54c-420b-8f65-2dee7e9dcf26 tempest-CreateVolumesFromImageTest-947949362 None] Deleted volume successfully. Nov 03 13:27:52 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d1077fdc-c54c-420b-8f65-2dee7e9dcf26 tempest-CreateVolumesFromImageTest-947949362 None] Lock "cinder-0c780359-d0fa-4d2a-bc88-22bc57451f90-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:27:52 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1a86696d-4144-4f2d-8473-a428ea9f3ab8 tempest-CreateVolumesFromImageTest-947949362 None] Acquiring lock "cinder-250c8842-9359-434c-8fbb-fbfb4bd3382c-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:27:52 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1a86696d-4144-4f2d-8473-a428ea9f3ab8 tempest-CreateVolumesFromImageTest-947949362 None] Lock "cinder-250c8842-9359-434c-8fbb-fbfb4bd3382c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:27:52 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1a86696d-4144-4f2d-8473-a428ea9f3ab8 tempest-CreateVolumesFromImageTest-947949362 None] Acquiring lock "cinder-quobyte-250c8842-9359-434c-8fbb-fbfb4bd3382c" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:27:52 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-886057cc-d8f4-477c-af34-ac3037a48b51 tempest-VolumeDependencyTests-154917658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78.786be806-ad9f-46e9-9cb9-571641abccb6" returned: 0 in 0.271s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:52 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1a86696d-4144-4f2d-8473-a428ea9f3ab8 tempest-CreateVolumesFromImageTest-947949362 None] Lock "cinder-quobyte-250c8842-9359-434c-8fbb-fbfb4bd3382c" acquired by "delete_volume" :: waited 0.018s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:27:52 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f9f13d-92b1-44ed-ab2e-8ed790c2bfc8]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:27:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1a86696d-4144-4f2d-8473-a428ea9f3ab8 tempest-CreateVolumesFromImageTest-947949362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-250c8842-9359-434c-8fbb-fbfb4bd3382c {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-886057cc-d8f4-477c-af34-ac3037a48b51 tempest-VolumeDependencyTests-154917658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:53 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78.info Nov 03 13:27:53 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:53 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-250c8842-9359-434c-8fbb-fbfb4bd3382c Nov 03 13:27:53 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:53 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-886057cc-d8f4-477c-af34-ac3037a48b51 tempest-VolumeDependencyTests-154917658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78.info" returned: 0 in 0.266s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:53 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-886057cc-d8f4-477c-af34-ac3037a48b51 tempest-VolumeDependencyTests-154917658 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78.info is being set with open permissions: ugo+rw Nov 03 13:27:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-886057cc-d8f4-477c-af34-ac3037a48b51 tempest-VolumeDependencyTests-154917658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:53 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78.info Nov 03 13:27:53 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:53 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1a86696d-4144-4f2d-8473-a428ea9f3ab8 tempest-CreateVolumesFromImageTest-947949362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-250c8842-9359-434c-8fbb-fbfb4bd3382c" returned: 0 in 0.365s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1a86696d-4144-4f2d-8473-a428ea9f3ab8 tempest-CreateVolumesFromImageTest-947949362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-250c8842-9359-434c-8fbb-fbfb4bd3382c {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:53 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-250c8842-9359-434c-8fbb-fbfb4bd3382c Nov 03 13:27:53 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:53 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-886057cc-d8f4-477c-af34-ac3037a48b51 tempest-VolumeDependencyTests-154917658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78.info" returned: 0 in 0.244s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-886057cc-d8f4-477c-af34-ac3037a48b51 tempest-VolumeDependencyTests-154917658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.168s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.210s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:53 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1189127688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36cf4e84-f563-4023-8910-c9f3301cc0b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad74210e3b154cfaae8409585ab92055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:27:47Z,use_quota=True,user_id='35bf0a206a824d0680e6923b93c4bbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:27:53 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Creating volume 36cf4e84-f563-4023-8910-c9f3301cc0b5 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:27:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:53 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:27:53 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:27:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:53 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:27:53 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:27:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-36cf4e84-f563-4023-8910-c9f3301cc0b5 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:53 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-36cf4e84-f563-4023-8910-c9f3301cc0b5 1073741824 Nov 03 13:27:53 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:53 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-886057cc-d8f4-477c-af34-ac3037a48b51 tempest-VolumeDependencyTests-154917658 None] Create snapshot completed successfully Nov 03 13:27:53 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1a86696d-4144-4f2d-8473-a428ea9f3ab8 tempest-CreateVolumesFromImageTest-947949362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-250c8842-9359-434c-8fbb-fbfb4bd3382c" returned: 0 in 0.258s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1a86696d-4144-4f2d-8473-a428ea9f3ab8 tempest-CreateVolumesFromImageTest-947949362 None] Lock "cinder-quobyte-250c8842-9359-434c-8fbb-fbfb4bd3382c" released by "delete_volume" :: held 0.666s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:27:53 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-1a86696d-4144-4f2d-8473-a428ea9f3ab8 tempest-CreateVolumesFromImageTest-947949362 None] Created reservations ['637489d1-8f17-4a5e-a734-e71438591418', 'baedc16a-c238-4a86-b1c2-2aa950b89d49', 'f47450af-4c8d-4b27-acf9-d9aa38537cfb', 'ccc987ee-19bf-4008-b5a8-7d574fceaed1'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:27:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1a86696d-4144-4f2d-8473-a428ea9f3ab8 tempest-CreateVolumesFromImageTest-947949362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1a86696d-4144-4f2d-8473-a428ea9f3ab8 tempest-CreateVolumesFromImageTest-947949362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:53 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1a86696d-4144-4f2d-8473-a428ea9f3ab8 tempest-CreateVolumesFromImageTest-947949362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:27:53 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1a86696d-4144-4f2d-8473-a428ea9f3ab8 tempest-CreateVolumesFromImageTest-947949362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:27:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1a86696d-4144-4f2d-8473-a428ea9f3ab8 tempest-CreateVolumesFromImageTest-947949362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1a86696d-4144-4f2d-8473-a428ea9f3ab8 tempest-CreateVolumesFromImageTest-947949362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:53 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:27:53 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:53 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1a86696d-4144-4f2d-8473-a428ea9f3ab8 tempest-CreateVolumesFromImageTest-947949362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.257s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:53 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-1a86696d-4144-4f2d-8473-a428ea9f3ab8 tempest-CreateVolumesFromImageTest-947949362 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:27:53 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:53 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-1a86696d-4144-4f2d-8473-a428ea9f3ab8 tempest-CreateVolumesFromImageTest-947949362 None] Deleted volume successfully. Nov 03 13:27:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-36cf4e84-f563-4023-8910-c9f3301cc0b5 1073741824" returned: 0 in 0.449s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1a86696d-4144-4f2d-8473-a428ea9f3ab8 tempest-CreateVolumesFromImageTest-947949362 None] Lock "cinder-250c8842-9359-434c-8fbb-fbfb4bd3382c-delete_volume" released by "delete_volume" :: held 1.119s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-36cf4e84-f563-4023-8910-c9f3301cc0b5 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a2c219a9-2f0b-485b-bc3a-551c57068c4a tempest-CreateVolumesFromImageTest-947949362 None] Acquiring lock "cinder-777bf02a-85b8-4b70-b4d9-93eb96beb7fc-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:27:54 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-36cf4e84-f563-4023-8910-c9f3301cc0b5 Nov 03 13:27:54 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a2c219a9-2f0b-485b-bc3a-551c57068c4a tempest-CreateVolumesFromImageTest-947949362 None] Lock "cinder-777bf02a-85b8-4b70-b4d9-93eb96beb7fc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a2c219a9-2f0b-485b-bc3a-551c57068c4a tempest-CreateVolumesFromImageTest-947949362 None] Acquiring lock "cinder-quobyte-777bf02a-85b8-4b70-b4d9-93eb96beb7fc" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a2c219a9-2f0b-485b-bc3a-551c57068c4a tempest-CreateVolumesFromImageTest-947949362 None] Lock "cinder-quobyte-777bf02a-85b8-4b70-b4d9-93eb96beb7fc" acquired by "delete_volume" :: waited 0.022s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a47d698-12e1-4416-83e6-052a9ce65f27]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a2c219a9-2f0b-485b-bc3a-551c57068c4a tempest-CreateVolumesFromImageTest-947949362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-777bf02a-85b8-4b70-b4d9-93eb96beb7fc {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:54 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:54 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-777bf02a-85b8-4b70-b4d9-93eb96beb7fc Nov 03 13:27:54 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-36cf4e84-f563-4023-8910-c9f3301cc0b5" returned: 0 in 0.252s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.003s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0616308e-3ebf-47d2-a252-fa1ff5518f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df162eaec22a46d9b3325566de0db19b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:27:46Z,use_quota=True,user_id='649fc4fd7fd74a8c8d842be354d7afd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89ff70cd-e7be-406c-9d27-e8f3dc547da3),volume_type_id=89ff70cd-e7be-406c-9d27-e8f3dc547da3)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Creating volume 0616308e-3ebf-47d2-a252-fa1ff5518f3d {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:27:54 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0616308e-3ebf-47d2-a252-fa1ff5518f3d 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29aad0c9-7d7c-4ae6-a6dd-b4802269c793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36cf4e84-f563-4023-8910-c9f3301cc0b5', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:54 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0616308e-3ebf-47d2-a252-fa1ff5518f3d 1073741824 Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd608ceb-f006-4939-b1e2-18e0141c5c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:54 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:54 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Volume volume-36cf4e84-f563-4023-8910-c9f3301cc0b5 (36cf4e84-f563-4023-8910-c9f3301cc0b5): created successfully Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd608ceb-f006-4939-b1e2-18e0141c5c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Flow 'volume_create_manager' (fe606ab5-77ba-4e75-ab78-1692674d5dfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:27:54 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-5dc413ee-6642-4e4e-a54b-11b8524c05a7 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Created volume successfully. Nov 03 13:27:54 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a2c219a9-2f0b-485b-bc3a-551c57068c4a tempest-CreateVolumesFromImageTest-947949362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-777bf02a-85b8-4b70-b4d9-93eb96beb7fc" returned: 0 in 0.420s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a2c219a9-2f0b-485b-bc3a-551c57068c4a tempest-CreateVolumesFromImageTest-947949362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-777bf02a-85b8-4b70-b4d9-93eb96beb7fc {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:54 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-777bf02a-85b8-4b70-b4d9-93eb96beb7fc Nov 03 13:27:54 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Flow 'volume_create_manager' (971380fb-7100-459d-8b78-22666f125d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a1f066-f132-4677-a225-a4195533dd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:54 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0616308e-3ebf-47d2-a252-fa1ff5518f3d 1073741824" returned: 0 in 0.572s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a1f066-f132-4677-a225-a4195533dd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-799907966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a9187d-0b40-4c3a-89bb-67790cebec3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88025e4dcbe64d47b569aae85e963d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=786be806-ad9f-46e9-9cb9-571641abccb6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:27:55Z,use_quota=True,user_id='989d3c641bf845bfa8dac174b4e1b4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a855cea3-5c80-4253-8cf2-fb6894fe0653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a855cea3-5c80-4253-8cf2-fb6894fe0653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (160b994c-3c7a-4d8a-8958-4408e142658c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (160b994c-3c7a-4d8a-8958-4408e142658c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '70a9187d-0b40-4c3a-89bb-67790cebec3d', 'volume_name': 'volume-70a9187d-0b40-4c3a-89bb-67790cebec3d', 'volume_size': 1, 'snapshot_id': '786be806-ad9f-46e9-9cb9-571641abccb6'}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:54 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ddb57a7-d5b7-47af-9dab-e52464f7951a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ddb57a7-d5b7-47af-9dab-e52464f7951a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0adeb812-aa2f-4448-bfae-e3d388f988ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:54 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Volume 70a9187d-0b40-4c3a-89bb-67790cebec3d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-70a9187d-0b40-4c3a-89bb-67790cebec3d', 'volume_size': 1, 'snapshot_id': '786be806-ad9f-46e9-9cb9-571641abccb6'} Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a2c219a9-2f0b-485b-bc3a-551c57068c4a tempest-CreateVolumesFromImageTest-947949362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-777bf02a-85b8-4b70-b4d9-93eb96beb7fc" returned: 0 in 0.350s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a2c219a9-2f0b-485b-bc3a-551c57068c4a tempest-CreateVolumesFromImageTest-947949362 None] Lock "cinder-quobyte-777bf02a-85b8-4b70-b4d9-93eb96beb7fc" released by "delete_volume" :: held 0.825s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:27:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0616308e-3ebf-47d2-a252-fa1ff5518f3d {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:54 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0616308e-3ebf-47d2-a252-fa1ff5518f3d Nov 03 13:27:54 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1763e131-792e-4914-88b0-d8055f7c4b07 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Acquiring lock "cinder-36cf4e84-f563-4023-8910-c9f3301cc0b5-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-a2c219a9-2f0b-485b-bc3a-551c57068c4a tempest-CreateVolumesFromImageTest-947949362 None] Created reservations ['16e0f53f-a1e0-4642-8154-505fc9f487f3', '5fad57fa-63d5-4512-ab09-0916227da83a', 'efda7a7f-f167-45c2-8554-aa3a72c62fa9', '3a808a19-abc2-4bee-9da4-887badb16525'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1763e131-792e-4914-88b0-d8055f7c4b07 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "cinder-36cf4e84-f563-4023-8910-c9f3301cc0b5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1763e131-792e-4914-88b0-d8055f7c4b07 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Acquiring lock "cinder-quobyte-36cf4e84-f563-4023-8910-c9f3301cc0b5" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1763e131-792e-4914-88b0-d8055f7c4b07 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "cinder-quobyte-36cf4e84-f563-4023-8910-c9f3301cc0b5" acquired by "delete_volume" :: waited 0.031s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a2c219a9-2f0b-485b-bc3a-551c57068c4a tempest-CreateVolumesFromImageTest-947949362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a2c219a9-2f0b-485b-bc3a-551c57068c4a tempest-CreateVolumesFromImageTest-947949362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a2c219a9-2f0b-485b-bc3a-551c57068c4a tempest-CreateVolumesFromImageTest-947949362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a2c219a9-2f0b-485b-bc3a-551c57068c4a tempest-CreateVolumesFromImageTest-947949362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a2c219a9-2f0b-485b-bc3a-551c57068c4a tempest-CreateVolumesFromImageTest-947949362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a2c219a9-2f0b-485b-bc3a-551c57068c4a tempest-CreateVolumesFromImageTest-947949362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[75438a6f-7c4b-43e7-914e-c2234eaa6839]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1763e131-792e-4914-88b0-d8055f7c4b07 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-36cf4e84-f563-4023-8910-c9f3301cc0b5 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:55 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:27:55 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:55 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0616308e-3ebf-47d2-a252-fa1ff5518f3d" returned: 0 in 0.307s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.343s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Acquiring lock "cinder-quobyte-786be806-ad9f-46e9-9cb9-571641abccb6-70a9187d-0b40-4c3a-89bb-67790cebec3d" by "_create_volume_from_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Lock "cinder-quobyte-786be806-ad9f-46e9-9cb9-571641abccb6-70a9187d-0b40-4c3a-89bb-67790cebec3d" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Creating volume 70a9187d-0b40-4c3a-89bb-67790cebec3d from snapshot 786be806-ad9f-46e9-9cb9-571641abccb6 {{(pid=86725) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Acquiring lock "cinder-quobyte-70a9187d-0b40-4c3a-89bb-67790cebec3d" by "_copy_volume_from_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:27:55 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-36cf4e84-f563-4023-8910-c9f3301cc0b5 Nov 03 13:27:55 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG cinder.volume.volume_utils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Attempting download of cfb459a7-43df-479a-a144-b8ed375d1cf6 ((None, [{'url': 'file:///opt/stack/data/glance/images/cfb459a7-43df-479a-a144-b8ed375d1cf6', 'metadata': {}}])) to volume 0616308e-3ebf-47d2-a252-fa1ff5518f3d. {{(pid=86725) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Lock "cinder-quobyte-70a9187d-0b40-4c3a-89bb-67790cebec3d" acquired by "_copy_volume_from_snapshot" :: waited 0.054s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] snapshot: 786be806-ad9f-46e9-9cb9-571641abccb6, volume: 70a9187d-0b40-4c3a-89bb-67790cebec3d, {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef46177e-3289-4f1c-b590-2635079bff3d]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78.786be806-ad9f-46e9-9cb9-571641abccb6 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:55 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1c1304-2923-4f35-adf2-16706efd9de6]: (4, 'raw') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cfb459a7-43df-479a-a144-b8ed375d1cf6_12mqdfet {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a2c219a9-2f0b-485b-bc3a-551c57068c4a tempest-CreateVolumesFromImageTest-947949362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.337s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-a2c219a9-2f0b-485b-bc3a-551c57068c4a tempest-CreateVolumesFromImageTest-947949362 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:27:55 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-a2c219a9-2f0b-485b-bc3a-551c57068c4a tempest-CreateVolumesFromImageTest-947949362 None] Deleted volume successfully. Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a2c219a9-2f0b-485b-bc3a-551c57068c4a tempest-CreateVolumesFromImageTest-947949362 None] Lock "cinder-777bf02a-85b8-4b70-b4d9-93eb96beb7fc-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:27:55 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78.786be806-ad9f-46e9-9cb9-571641abccb6 Nov 03 13:27:55 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:55 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cfb459a7-43df-479a-a144-b8ed375d1cf6_12mqdfet Nov 03 13:27:55 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:55 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1763e131-792e-4914-88b0-d8055f7c4b07 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-36cf4e84-f563-4023-8910-c9f3301cc0b5" returned: 0 in 0.484s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1763e131-792e-4914-88b0-d8055f7c4b07 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-36cf4e84-f563-4023-8910-c9f3301cc0b5 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:55 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-36cf4e84-f563-4023-8910-c9f3301cc0b5 Nov 03 13:27:55 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:55 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cfb459a7-43df-479a-a144-b8ed375d1cf6_12mqdfet" returned: 0 in 0.391s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfb459a7-43df-479a-a144-b8ed375d1cf6_12mqdfet {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:55 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78.786be806-ad9f-46e9-9cb9-571641abccb6" returned: 0 in 0.465s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62ed0551-ac41-4162-83b3-09f7624dfe78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5897c49-0e47-4ecd-b269-b54f029fac55]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:55 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1763e131-792e-4914-88b0-d8055f7c4b07 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-36cf4e84-f563-4023-8910-c9f3301cc0b5" returned: 0 in 0.317s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:56 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1763e131-792e-4914-88b0-d8055f7c4b07 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "cinder-quobyte-36cf4e84-f563-4023-8910-c9f3301cc0b5" released by "delete_volume" :: held 0.896s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:27:56 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfb459a7-43df-479a-a144-b8ed375d1cf6_12mqdfet Nov 03 13:27:56 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:56 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-1763e131-792e-4914-88b0-d8055f7c4b07 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Created reservations ['e1cfcdd0-855f-4649-8776-d99c1966c5fb', '2d8931ec-133a-462a-bf6a-6eb5c21aeaf8', '641d8b41-529d-499f-9ea2-77a2674808d7', '14e7cfb3-281c-4f91-9a55-5370230bf91e'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:27:56 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78 Nov 03 13:27:56 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1763e131-792e-4914-88b0-d8055f7c4b07 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1763e131-792e-4914-88b0-d8055f7c4b07 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:56 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1763e131-792e-4914-88b0-d8055f7c4b07 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:27:56 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1763e131-792e-4914-88b0-d8055f7c4b07 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:27:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1763e131-792e-4914-88b0-d8055f7c4b07 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1763e131-792e-4914-88b0-d8055f7c4b07 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:56 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:27:56 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:56 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-2ba2c0bc-b3a2-4c8c-b2ad-1124deead897 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Acquiring lock "cinder-c7df21b7-53a7-46af-9acf-9e2d210cbbd8-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:27:56 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-2ba2c0bc-b3a2-4c8c-b2ad-1124deead897 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "cinder-c7df21b7-53a7-46af-9acf-9e2d210cbbd8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:27:56 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfb459a7-43df-479a-a144-b8ed375d1cf6_12mqdfet" returned: 1 in 0.457s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfb459a7-43df-479a-a144-b8ed375d1cf6_12mqdfet' failed. Not Retrying. {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:27:56 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4978d4-065c-444c-a079-1244f1294486]: (4, 'raw') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:27:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfb459a7-43df-479a-a144-b8ed375d1cf6_a1mkvndudevstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:56 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-2ba2c0bc-b3a2-4c8c-b2ad-1124deead897 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Acquiring lock "cinder-quobyte-c7df21b7-53a7-46af-9acf-9e2d210cbbd8" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:27:56 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-2ba2c0bc-b3a2-4c8c-b2ad-1124deead897 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "cinder-quobyte-c7df21b7-53a7-46af-9acf-9e2d210cbbd8" acquired by "delete_volume" :: waited 0.022s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:27:56 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[a493cb8b-5fee-47bb-aff9-92fd1398b7d5]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:27:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2ba2c0bc-b3a2-4c8c-b2ad-1124deead897 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c7df21b7-53a7-46af-9acf-9e2d210cbbd8 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:56 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfb459a7-43df-479a-a144-b8ed375d1cf6_a1mkvndudevstack@QuobyteHD Nov 03 13:27:56 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:56 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78" returned: 0 in 0.694s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:56 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78 {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 13:27:56 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Creating direct copy from snapshot {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 13:27:56 devstack cinder-volume[86725]: DEBUG cinder.utils [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Path /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-70a9187d-0b40-4c3a-89bb-67790cebec3d not found in is_blk_device check {{(pid=86725) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 13:27:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-70a9187d-0b40-4c3a-89bb-67790cebec3d {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:56 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1763e131-792e-4914-88b0-d8055f7c4b07 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.473s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:56 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-1763e131-792e-4914-88b0-d8055f7c4b07 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:27:56 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-1763e131-792e-4914-88b0-d8055f7c4b07 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Deleted volume successfully. Nov 03 13:27:56 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-70a9187d-0b40-4c3a-89bb-67790cebec3d Nov 03 13:27:56 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:56 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c7df21b7-53a7-46af-9acf-9e2d210cbbd8 Nov 03 13:27:56 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:56 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1763e131-792e-4914-88b0-d8055f7c4b07 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "cinder-36cf4e84-f563-4023-8910-c9f3301cc0b5-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:27:56 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfb459a7-43df-479a-a144-b8ed375d1cf6_a1mkvndudevstack@QuobyteHD" returned: 0 in 0.497s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfb459a7-43df-479a-a144-b8ed375d1cf6_a1mkvndudevstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:56 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfb459a7-43df-479a-a144-b8ed375d1cf6_a1mkvndudevstack@QuobyteHD Nov 03 13:27:56 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:57 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2ba2c0bc-b3a2-4c8c-b2ad-1124deead897 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c7df21b7-53a7-46af-9acf-9e2d210cbbd8" returned: 0 in 0.563s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2ba2c0bc-b3a2-4c8c-b2ad-1124deead897 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c7df21b7-53a7-46af-9acf-9e2d210cbbd8 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:57 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c7df21b7-53a7-46af-9acf-9e2d210cbbd8 Nov 03 13:27:57 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:57 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfb459a7-43df-479a-a144-b8ed375d1cf6_a1mkvndudevstack@QuobyteHD" returned: 1 in 0.408s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfb459a7-43df-479a-a144-b8ed375d1cf6_a1mkvndudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:27:57 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] cfb459a7-43df-479a-a144-b8ed375d1cf6 was raw, converting to qcow2 {{(pid=86725) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 13:27:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cfb459a7-43df-479a-a144-b8ed375d1cf6_a1mkvndudevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0616308e-3ebf-47d2-a252-fa1ff5518f3d {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:57 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cfb459a7-43df-479a-a144-b8ed375d1cf6_a1mkvndudevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0616308e-3ebf-47d2-a252-fa1ff5518f3d Nov 03 13:27:57 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:57 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2ba2c0bc-b3a2-4c8c-b2ad-1124deead897 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-c7df21b7-53a7-46af-9acf-9e2d210cbbd8" returned: 0 in 0.399s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:57 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-2ba2c0bc-b3a2-4c8c-b2ad-1124deead897 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "cinder-quobyte-c7df21b7-53a7-46af-9acf-9e2d210cbbd8" released by "delete_volume" :: held 1.051s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:27:57 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-2ba2c0bc-b3a2-4c8c-b2ad-1124deead897 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Created reservations ['69e3224c-8e21-4be2-aabd-0bd5c699ae43', 'c5962b93-a7c9-4dc1-81d1-22718aada3e1', 'a0c8b455-3bfb-499b-b958-786ed849dde9', '7e2526e4-af32-4cd4-9174-196ea7d500b3'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:27:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2ba2c0bc-b3a2-4c8c-b2ad-1124deead897 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2ba2c0bc-b3a2-4c8c-b2ad-1124deead897 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:57 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2ba2c0bc-b3a2-4c8c-b2ad-1124deead897 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:27:57 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2ba2c0bc-b3a2-4c8c-b2ad-1124deead897 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:27:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2ba2c0bc-b3a2-4c8c-b2ad-1124deead897 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2ba2c0bc-b3a2-4c8c-b2ad-1124deead897 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:57 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:27:57 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:58 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2ba2c0bc-b3a2-4c8c-b2ad-1124deead897 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.418s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:58 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-2ba2c0bc-b3a2-4c8c-b2ad-1124deead897 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:27:58 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-2ba2c0bc-b3a2-4c8c-b2ad-1124deead897 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Deleted volume successfully. Nov 03 13:27:58 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-2ba2c0bc-b3a2-4c8c-b2ad-1124deead897 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "cinder-c7df21b7-53a7-46af-9acf-9e2d210cbbd8-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:27:58 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cfb459a7-43df-479a-a144-b8ed375d1cf6_a1mkvndudevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0616308e-3ebf-47d2-a252-fa1ff5518f3d" returned: 0 in 1.289s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:58 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cfb459a7-43df-479a-a144-b8ed375d1cf6_a1mkvndudevstack@QuobyteHD, size 0.00 MB, duration 1.29 sec, destination /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0616308e-3ebf-47d2-a252-fa1ff5518f3d {{(pid=86725) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:27:58 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 13:27:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0616308e-3ebf-47d2-a252-fa1ff5518f3d 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:58 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0616308e-3ebf-47d2-a252-fa1ff5518f3d 1G Nov 03 13:27:58 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:58 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9ecc5a6d-61e1-410e-8aeb-9a87385564e0 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Acquiring lock "cinder-0cf3f1a3-4d56-4321-801a-9d52da0ef5b6-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:27:58 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:27:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:27:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:27:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:27:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:27:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:27:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:58 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9ecc5a6d-61e1-410e-8aeb-9a87385564e0 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "cinder-0cf3f1a3-4d56-4321-801a-9d52da0ef5b6-delete_volume" acquired by "delete_volume" :: waited 0.114s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:27:58 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:27:58 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:59 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9ecc5a6d-61e1-410e-8aeb-9a87385564e0 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Acquiring lock "cinder-quobyte-0cf3f1a3-4d56-4321-801a-9d52da0ef5b6" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:27:59 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9ecc5a6d-61e1-410e-8aeb-9a87385564e0 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "cinder-quobyte-0cf3f1a3-4d56-4321-801a-9d52da0ef5b6" acquired by "delete_volume" :: waited 0.047s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:27:59 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[6352656d-4fea-4ab3-8818-3cbbd94558c4]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:27:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9ecc5a6d-61e1-410e-8aeb-9a87385564e0 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0cf3f1a3-4d56-4321-801a-9d52da0ef5b6 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:27:59 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0616308e-3ebf-47d2-a252-fa1ff5518f3d 1G" returned: 0 in 0.870s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:59 devstack cinder-volume[86725]: DEBUG cinder.volume.volume_utils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Downloaded image cfb459a7-43df-479a-a144-b8ed375d1cf6 ((None, [{'url': 'file:///opt/stack/data/glance/images/cfb459a7-43df-479a-a144-b8ed375d1cf6', 'metadata': {}}])) to volume 0616308e-3ebf-47d2-a252-fa1ff5518f3d successfully. {{(pid=86725) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 13:27:59 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Temporary image cfb459a7-43df-479a-a144-b8ed375d1cf6 for user 649fc4fd7fd74a8c8d842be354d7afd0 is deleted. {{(pid=86725) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 13:27:59 devstack cinder-volume[86725]: DEBUG cinder.volume.volume_utils [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Marking volume 0616308e-3ebf-47d2-a252-fa1ff5518f3d as bootable. {{(pid=86725) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 13:27:59 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Copying metadata from image cfb459a7-43df-479a-a144-b8ed375d1cf6 to 0616308e-3ebf-47d2-a252-fa1ff5518f3d. {{(pid=86725) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 13:27:59 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Creating volume glance metadata for volume 0616308e-3ebf-47d2-a252-fa1ff5518f3d backed by image cfb459a7-43df-479a-a144-b8ed375d1cf6 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'cfb459a7-43df-479a-a144-b8ed375d1cf6', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '404622b69f06e2a53d2dce805847f51c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86725) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 13:27:59 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0cf3f1a3-4d56-4321-801a-9d52da0ef5b6 Nov 03 13:27:59 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:27:59 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Nov 03 13:27:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (478f22f9-7d7d-42dd-93da-b054752fe071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0616308e-3ebf-47d2-a252-fa1ff5518f3d', 'volume_size': 1, 'image_id': 'cfb459a7-43df-479a-a144-b8ed375d1cf6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cfb459a7-43df-479a-a144-b8ed375d1cf6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '404622b69f06e2a53d2dce805847f51c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'df162eaec22a46d9b3325566de0db19b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a40360518673fc0372f309622d8e259f00a40a83e10cd0096b7cdcaf9cca4df413af6eb0cda560b4a63cce35f46c90d299fd2bf9737d108dea46789fd2c61ff', 'id': 'cfb459a7-43df-479a-a144-b8ed375d1cf6', 'created_at': datetime.datetime(2026, 11, 3, 12, 27, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 27, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cfb459a7-43df-479a-a144-b8ed375d1cf6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (221154ec-5b07-44d0-930a-d7b9205d0653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:27:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.829s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:27:59 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:27:59 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager._thread_info {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:27:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread count: 28 {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:27:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread info: [<_MainThread(MainThread, started 133507074375808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:27:59 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Volume volume-0616308e-3ebf-47d2-a252-fa1ff5518f3d (0616308e-3ebf-47d2-a252-fa1ff5518f3d): created successfully Nov 03 13:27:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (221154ec-5b07-44d0-930a-d7b9205d0653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:27:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Flow 'volume_create_manager' (00ebb6fd-d888-4fbb-9c53-02b8e702edd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:27:59 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-37934b6c-aa97-4ce6-88b3-dabc6d381e4c tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Created volume successfully. Nov 03 13:28:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1afc7509-d569-4fa9-9392-3e9829d7f81e tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Acquiring lock "cinder-0616308e-3ebf-47d2-a252-fa1ff5518f3d-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1afc7509-d569-4fa9-9392-3e9829d7f81e tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Lock "cinder-0616308e-3ebf-47d2-a252-fa1ff5518f3d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:00 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9ecc5a6d-61e1-410e-8aeb-9a87385564e0 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0cf3f1a3-4d56-4321-801a-9d52da0ef5b6" returned: 0 in 0.958s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9ecc5a6d-61e1-410e-8aeb-9a87385564e0 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0cf3f1a3-4d56-4321-801a-9d52da0ef5b6 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:00 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0cf3f1a3-4d56-4321-801a-9d52da0ef5b6 Nov 03 13:28:00 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1afc7509-d569-4fa9-9392-3e9829d7f81e tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Acquiring lock "cinder-quobyte-0616308e-3ebf-47d2-a252-fa1ff5518f3d" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1afc7509-d569-4fa9-9392-3e9829d7f81e tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Lock "cinder-quobyte-0616308e-3ebf-47d2-a252-fa1ff5518f3d" acquired by "delete_volume" :: waited 0.059s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:00 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1a13fe-e6cd-45fd-9fc8-451da195fcc4]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1afc7509-d569-4fa9-9392-3e9829d7f81e tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0616308e-3ebf-47d2-a252-fa1ff5518f3d {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:00 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0616308e-3ebf-47d2-a252-fa1ff5518f3d Nov 03 13:28:00 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:00 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:28:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Flow 'volume_create_manager' (1c16d9af-7b60-494b-b571-21f1bb510c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccf9f532-ff9a-4a62-b1e0-d1b53dd1872f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccf9f532-ff9a-4a62-b1e0-d1b53dd1872f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1005267747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d66b2ed-5636-4905-ba38-61575c04ad15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12163086a4d645fab0abd4f6b20a5b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:01Z,use_quota=True,user_id='6860d03379374f96bd09921865d5bbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea129ecf-2d83-44dc-93d8-35c1d2825390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea129ecf-2d83-44dc-93d8-35c1d2825390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:00 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f9ca396-9486-4186-a766-c642453d904f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f9ca396-9486-4186-a766-c642453d904f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d66b2ed-5636-4905-ba38-61575c04ad15', 'volume_name': 'volume-6d66b2ed-5636-4905-ba38-61575c04ad15', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda80dcd-f32f-4796-976e-6ba5025d2db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda80dcd-f32f-4796-976e-6ba5025d2db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1653f754-0fda-41b6-8edd-28d2d4fbf9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:00 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Volume 6d66b2ed-5636-4905-ba38-61575c04ad15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d66b2ed-5636-4905-ba38-61575c04ad15', 'volume_size': 1} Nov 03 13:28:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9ecc5a6d-61e1-410e-8aeb-9a87385564e0 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0cf3f1a3-4d56-4321-801a-9d52da0ef5b6" returned: 0 in 0.680s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9ecc5a6d-61e1-410e-8aeb-9a87385564e0 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "cinder-quobyte-0cf3f1a3-4d56-4321-801a-9d52da0ef5b6" released by "delete_volume" :: held 1.784s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:01 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-9ecc5a6d-61e1-410e-8aeb-9a87385564e0 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Created reservations ['772cb4c7-4903-474c-b38d-a90b4df0a90e', '0ed05104-26a6-4254-b2aa-ddfde0543eb2', '2ad92ac8-26b4-47ec-9714-a692157cf752', '37613e0b-793f-4b4c-a0e7-9243db16b07a'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9ecc5a6d-61e1-410e-8aeb-9a87385564e0 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9ecc5a6d-61e1-410e-8aeb-9a87385564e0 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:01 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-9ecc5a6d-61e1-410e-8aeb-9a87385564e0 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:01 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-9ecc5a6d-61e1-410e-8aeb-9a87385564e0 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9ecc5a6d-61e1-410e-8aeb-9a87385564e0 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9ecc5a6d-61e1-410e-8aeb-9a87385564e0 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1afc7509-d569-4fa9-9392-3e9829d7f81e tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0616308e-3ebf-47d2-a252-fa1ff5518f3d" returned: 0 in 0.824s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:01 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1afc7509-d569-4fa9-9392-3e9829d7f81e tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0616308e-3ebf-47d2-a252-fa1ff5518f3d {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:01 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:28:01 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:01 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0616308e-3ebf-47d2-a252-fa1ff5518f3d Nov 03 13:28:01 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b2eff8e1-0cd4-4232-8c2c-fcf00a95b622 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Acquiring lock "cinder-158ee86c-8aab-4dc8-ba3c-3ac0c19ca4b3-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b2eff8e1-0cd4-4232-8c2c-fcf00a95b622 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "cinder-158ee86c-8aab-4dc8-ba3c-3ac0c19ca4b3-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b2eff8e1-0cd4-4232-8c2c-fcf00a95b622 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Acquiring lock "cinder-quobyte-158ee86c-8aab-4dc8-ba3c-3ac0c19ca4b3" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b2eff8e1-0cd4-4232-8c2c-fcf00a95b622 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "cinder-quobyte-158ee86c-8aab-4dc8-ba3c-3ac0c19ca4b3" acquired by "delete_volume" :: waited 0.033s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:01 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb75c7f7-02b8-401c-96e2-d3a1b3deb6bb]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b2eff8e1-0cd4-4232-8c2c-fcf00a95b622 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-158ee86c-8aab-4dc8-ba3c-3ac0c19ca4b3 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:01 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1afc7509-d569-4fa9-9392-3e9829d7f81e tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0616308e-3ebf-47d2-a252-fa1ff5518f3d" returned: 0 in 0.471s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1afc7509-d569-4fa9-9392-3e9829d7f81e tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Lock "cinder-quobyte-0616308e-3ebf-47d2-a252-fa1ff5518f3d" released by "delete_volume" :: held 1.463s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:01 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-158ee86c-8aab-4dc8-ba3c-3ac0c19ca4b3 Nov 03 13:28:01 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:01 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9ecc5a6d-61e1-410e-8aeb-9a87385564e0 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.671s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:01 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-9ecc5a6d-61e1-410e-8aeb-9a87385564e0 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:28:01 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-1afc7509-d569-4fa9-9392-3e9829d7f81e tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Created reservations ['b7312b70-d28e-429e-bab4-223cda6b5875', '4abe208e-1ea8-4e24-aff9-9884bde7c46c', '918bac79-4f63-4eaa-9964-42d468de5687', '1df588f0-fd01-45e0-ac1a-c576ba2a7a31'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:01 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-9ecc5a6d-61e1-410e-8aeb-9a87385564e0 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Deleted volume successfully. Nov 03 13:28:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9ecc5a6d-61e1-410e-8aeb-9a87385564e0 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "cinder-0cf3f1a3-4d56-4321-801a-9d52da0ef5b6-delete_volume" released by "delete_volume" :: held 3.087s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1afc7509-d569-4fa9-9392-3e9829d7f81e tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1afc7509-d569-4fa9-9392-3e9829d7f81e tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:02 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1afc7509-d569-4fa9-9392-3e9829d7f81e tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:02 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-1afc7509-d569-4fa9-9392-3e9829d7f81e tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1afc7509-d569-4fa9-9392-3e9829d7f81e tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1afc7509-d569-4fa9-9392-3e9829d7f81e tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:02 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:28:02 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:02 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b2eff8e1-0cd4-4232-8c2c-fcf00a95b622 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-158ee86c-8aab-4dc8-ba3c-3ac0c19ca4b3" returned: 0 in 0.593s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b2eff8e1-0cd4-4232-8c2c-fcf00a95b622 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-158ee86c-8aab-4dc8-ba3c-3ac0c19ca4b3 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:02 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-158ee86c-8aab-4dc8-ba3c-3ac0c19ca4b3 Nov 03 13:28:02 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:02 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1afc7509-d569-4fa9-9392-3e9829d7f81e tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.421s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:02 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-1afc7509-d569-4fa9-9392-3e9829d7f81e tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:28:02 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-1afc7509-d569-4fa9-9392-3e9829d7f81e tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Deleted volume successfully. Nov 03 13:28:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1afc7509-d569-4fa9-9392-3e9829d7f81e tempest-VolumeAndVolumeTypeFromImageTest-644557818 None] Lock "cinder-0616308e-3ebf-47d2-a252-fa1ff5518f3d-delete_volume" released by "delete_volume" :: held 2.480s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:02 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b2eff8e1-0cd4-4232-8c2c-fcf00a95b622 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-158ee86c-8aab-4dc8-ba3c-3ac0c19ca4b3" returned: 0 in 0.605s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b2eff8e1-0cd4-4232-8c2c-fcf00a95b622 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "cinder-quobyte-158ee86c-8aab-4dc8-ba3c-3ac0c19ca4b3" released by "delete_volume" :: held 1.318s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:03 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-b2eff8e1-0cd4-4232-8c2c-fcf00a95b622 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Created reservations ['93a11aea-4829-4bf5-906f-c84e1d7b41c1', 'cb63002e-9135-4a9c-9a51-b7e3795f908b', '10219fc5-4f10-46c2-9b46-0f40addcfeb1', 'c22567d4-b76a-493c-a28b-a052c677bd18'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b2eff8e1-0cd4-4232-8c2c-fcf00a95b622 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b2eff8e1-0cd4-4232-8c2c-fcf00a95b622 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:03 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b2eff8e1-0cd4-4232-8c2c-fcf00a95b622 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:03 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b2eff8e1-0cd4-4232-8c2c-fcf00a95b622 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b2eff8e1-0cd4-4232-8c2c-fcf00a95b622 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b2eff8e1-0cd4-4232-8c2c-fcf00a95b622 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:03 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:28:03 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:03 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b2eff8e1-0cd4-4232-8c2c-fcf00a95b622 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.411s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:03 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-b2eff8e1-0cd4-4232-8c2c-fcf00a95b622 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:28:03 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-b2eff8e1-0cd4-4232-8c2c-fcf00a95b622 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Deleted volume successfully. Nov 03 13:28:03 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b2eff8e1-0cd4-4232-8c2c-fcf00a95b622 tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "cinder-158ee86c-8aab-4dc8-ba3c-3ac0c19ca4b3-delete_volume" released by "delete_volume" :: held 2.233s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:03 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-74c2bcc2-935c-4b91-a64f-2d6f638ad11a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Acquiring lock "cinder-f1b0b641-8776-40ce-9420-a9f5eb5879f8-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:03 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-74c2bcc2-935c-4b91-a64f-2d6f638ad11a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "cinder-f1b0b641-8776-40ce-9420-a9f5eb5879f8-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:04 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-74c2bcc2-935c-4b91-a64f-2d6f638ad11a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Acquiring lock "cinder-quobyte-f1b0b641-8776-40ce-9420-a9f5eb5879f8" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:04 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-74c2bcc2-935c-4b91-a64f-2d6f638ad11a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "cinder-quobyte-f1b0b641-8776-40ce-9420-a9f5eb5879f8" acquired by "delete_volume" :: waited 0.038s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:04 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdf16a9-3ddd-4a83-b791-214df82a20f6]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-74c2bcc2-935c-4b91-a64f-2d6f638ad11a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f1b0b641-8776-40ce-9420-a9f5eb5879f8 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:04 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f1b0b641-8776-40ce-9420-a9f5eb5879f8 Nov 03 13:28:04 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:05 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-74c2bcc2-935c-4b91-a64f-2d6f638ad11a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f1b0b641-8776-40ce-9420-a9f5eb5879f8" returned: 0 in 0.895s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-74c2bcc2-935c-4b91-a64f-2d6f638ad11a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f1b0b641-8776-40ce-9420-a9f5eb5879f8 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:05 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f1b0b641-8776-40ce-9420-a9f5eb5879f8 Nov 03 13:28:05 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:05 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-74c2bcc2-935c-4b91-a64f-2d6f638ad11a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f1b0b641-8776-40ce-9420-a9f5eb5879f8" returned: 0 in 0.535s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:05 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-74c2bcc2-935c-4b91-a64f-2d6f638ad11a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "cinder-quobyte-f1b0b641-8776-40ce-9420-a9f5eb5879f8" released by "delete_volume" :: held 1.534s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:05 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:05 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-74c2bcc2-935c-4b91-a64f-2d6f638ad11a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Created reservations ['ad65fa1a-81cf-4071-8803-b06e5c3dff49', '0134c31f-e502-4e38-83b2-feb586b101f8', '468e8ae0-40c5-436a-a6ee-4283a31dce5b', '7ec2351e-bfd3-49fe-a57f-e156f0194cb5'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-70a9187d-0b40-4c3a-89bb-67790cebec3d" returned: 0 in 9.054s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:05 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78, size 1024.00 MB, duration 9.06 sec, destination /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-70a9187d-0b40-4c3a-89bb-67790cebec3d {{(pid=86725) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:28:05 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Converted 1024.00 MB image at 113.06 MB/s Nov 03 13:28:05 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-70a9187d-0b40-4c3a-89bb-67790cebec3d is being set with open permissions: ugo+rw Nov 03 13:28:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-70a9187d-0b40-4c3a-89bb-67790cebec3d {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:05 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-70a9187d-0b40-4c3a-89bb-67790cebec3d Nov 03 13:28:05 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-74c2bcc2-935c-4b91-a64f-2d6f638ad11a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-74c2bcc2-935c-4b91-a64f-2d6f638ad11a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:05 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-74c2bcc2-935c-4b91-a64f-2d6f638ad11a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:05 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-74c2bcc2-935c-4b91-a64f-2d6f638ad11a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-74c2bcc2-935c-4b91-a64f-2d6f638ad11a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-74c2bcc2-935c-4b91-a64f-2d6f638ad11a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:05 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:28:05 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:05 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-70a9187d-0b40-4c3a-89bb-67790cebec3d" returned: 0 in 0.269s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Lock "cinder-quobyte-70a9187d-0b40-4c3a-89bb-67790cebec3d" released by "_copy_volume_from_snapshot" :: held 10.624s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Lock "cinder-quobyte-786be806-ad9f-46e9-9cb9-571641abccb6-70a9187d-0b40-4c3a-89bb-67790cebec3d" released by "_create_volume_from_snapshot" :: held 10.753s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.786s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.223s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1005267747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d66b2ed-5636-4905-ba38-61575c04ad15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12163086a4d645fab0abd4f6b20a5b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:01Z,use_quota=True,user_id='6860d03379374f96bd09921865d5bbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Creating volume 6d66b2ed-5636-4905-ba38-61575c04ad15 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:28:06 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:06 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-74c2bcc2-935c-4b91-a64f-2d6f638ad11a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.309s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-74c2bcc2-935c-4b91-a64f-2d6f638ad11a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:28:06 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15 1073741824 Nov 03 13:28:06 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:06 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-74c2bcc2-935c-4b91-a64f-2d6f638ad11a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Deleted volume successfully. Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0adeb812-aa2f-4448-bfae-e3d388f988ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70a9187d-0b40-4c3a-89bb-67790cebec3d', 'volume_size': 1, 'snapshot_id': '786be806-ad9f-46e9-9cb9-571641abccb6'}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78cd1a66-ebeb-4e8e-a69d-564117e71ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:06 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Volume volume-70a9187d-0b40-4c3a-89bb-67790cebec3d (70a9187d-0b40-4c3a-89bb-67790cebec3d): created successfully Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78cd1a66-ebeb-4e8e-a69d-564117e71ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Flow 'volume_create_manager' (971380fb-7100-459d-8b78-22666f125d60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-74c2bcc2-935c-4b91-a64f-2d6f638ad11a tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "cinder-f1b0b641-8776-40ce-9420-a9f5eb5879f8-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:06 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-1790ac48-92e4-485a-ab9f-c04a0363c80f tempest-VolumeDependencyTests-154917658 None] Created volume successfully. Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-79222d66-4fab-4bc6-9994-e24ea78eae2e tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Acquiring lock "cinder-68765115-991e-40da-b912-b8e76d1537ce-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-79222d66-4fab-4bc6-9994-e24ea78eae2e tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "cinder-68765115-991e-40da-b912-b8e76d1537ce-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-79222d66-4fab-4bc6-9994-e24ea78eae2e tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Acquiring lock "cinder-quobyte-68765115-991e-40da-b912-b8e76d1537ce" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-79222d66-4fab-4bc6-9994-e24ea78eae2e tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "cinder-quobyte-68765115-991e-40da-b912-b8e76d1537ce" acquired by "delete_volume" :: waited 0.017s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a9ff70-6d70-4ac6-a810-7105f0acd1fb]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-79222d66-4fab-4bc6-9994-e24ea78eae2e tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-68765115-991e-40da-b912-b8e76d1537ce {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:06 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-68765115-991e-40da-b912-b8e76d1537ce Nov 03 13:28:06 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:06 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15 1073741824" returned: 0 in 0.547s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:06 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15 Nov 03 13:28:06 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:06 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-79222d66-4fab-4bc6-9994-e24ea78eae2e tempest-CreateVolumesFromSourceVolumeTest-438771466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-68765115-991e-40da-b912-b8e76d1537ce" returned: 0 in 0.409s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-79222d66-4fab-4bc6-9994-e24ea78eae2e tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-68765115-991e-40da-b912-b8e76d1537ce {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:06 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-68765115-991e-40da-b912-b8e76d1537ce Nov 03 13:28:06 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:06 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15" returned: 0 in 0.280s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1653f754-0fda-41b6-8edd-28d2d4fbf9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d66b2ed-5636-4905-ba38-61575c04ad15', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da8de297-27b5-4d14-8b29-95ca69ca1864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:07 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Volume volume-6d66b2ed-5636-4905-ba38-61575c04ad15 (6d66b2ed-5636-4905-ba38-61575c04ad15): created successfully Nov 03 13:28:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da8de297-27b5-4d14-8b29-95ca69ca1864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:07 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Flow 'volume_create_manager' (1c16d9af-7b60-494b-b571-21f1bb510c12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:07 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-63a50c9c-b876-424d-b764-d5132c9c9ff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Created volume successfully. Nov 03 13:28:07 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-79222d66-4fab-4bc6-9994-e24ea78eae2e tempest-CreateVolumesFromSourceVolumeTest-438771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-68765115-991e-40da-b912-b8e76d1537ce" returned: 0 in 0.277s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:07 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-79222d66-4fab-4bc6-9994-e24ea78eae2e tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "cinder-quobyte-68765115-991e-40da-b912-b8e76d1537ce" released by "delete_volume" :: held 0.733s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:07 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-79222d66-4fab-4bc6-9994-e24ea78eae2e tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Created reservations ['84dc12aa-481c-4d05-a94a-c36e3d6a0b74', '4d6d297a-065c-451b-a014-5427f74a3d3d', '74caca06-a6b3-46fa-9cad-2e36f68dc287', 'f0d6c223-bc4c-4fe1-807d-9f89f0112d02'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:07 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-74d80e39-2a77-4060-bc4e-c2bc207b8ba0 tempest-VolumeDependencyTests-154917658 None] Acquiring lock "cinder-786be806-ad9f-46e9-9cb9-571641abccb6-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-79222d66-4fab-4bc6-9994-e24ea78eae2e tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-79222d66-4fab-4bc6-9994-e24ea78eae2e tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:07 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-79222d66-4fab-4bc6-9994-e24ea78eae2e tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:07 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-79222d66-4fab-4bc6-9994-e24ea78eae2e tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-79222d66-4fab-4bc6-9994-e24ea78eae2e tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-79222d66-4fab-4bc6-9994-e24ea78eae2e tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:07 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-74d80e39-2a77-4060-bc4e-c2bc207b8ba0 tempest-VolumeDependencyTests-154917658 None] Lock "cinder-786be806-ad9f-46e9-9cb9-571641abccb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:07 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-74d80e39-2a77-4060-bc4e-c2bc207b8ba0 tempest-VolumeDependencyTests-154917658 None] Acquiring lock "cinder-quobyte-62ed0551-ac41-4162-83b3-09f7624dfe78" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:07 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:28:07 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:07 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-74d80e39-2a77-4060-bc4e-c2bc207b8ba0 tempest-VolumeDependencyTests-154917658 None] Lock "cinder-quobyte-62ed0551-ac41-4162-83b3-09f7624dfe78" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:07 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-74d80e39-2a77-4060-bc4e-c2bc207b8ba0 tempest-VolumeDependencyTests-154917658 None] Acquiring lock "cinder-quobyte-786be806-ad9f-46e9-9cb9-571641abccb6" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:07 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-74d80e39-2a77-4060-bc4e-c2bc207b8ba0 tempest-VolumeDependencyTests-154917658 None] Lock "cinder-quobyte-786be806-ad9f-46e9-9cb9-571641abccb6" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:07 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-74d80e39-2a77-4060-bc4e-c2bc207b8ba0 tempest-VolumeDependencyTests-154917658 None] Deleting offline snapshot 786be806-ad9f-46e9-9cb9-571641abccb6 of volume 62ed0551-ac41-4162-83b3-09f7624dfe78 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:28:07 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-74d80e39-2a77-4060-bc4e-c2bc207b8ba0 tempest-VolumeDependencyTests-154917658 None] snapshot_file for this snap is: volume-62ed0551-ac41-4162-83b3-09f7624dfe78.786be806-ad9f-46e9-9cb9-571641abccb6 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:28:07 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d43f04-9d22-4826-8842-ab3434bce9d8]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-74d80e39-2a77-4060-bc4e-c2bc207b8ba0 tempest-VolumeDependencyTests-154917658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78.786be806-ad9f-46e9-9cb9-571641abccb6 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:07 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78.786be806-ad9f-46e9-9cb9-571641abccb6 Nov 03 13:28:07 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f63c55fe-2ead-464e-b3bd-1b05987a7f37 tempest-CreateVolumesFromSnapshotTest-846457304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f63c55fe-2ead-464e-b3bd-1b05987a7f37 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:07 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-79222d66-4fab-4bc6-9994-e24ea78eae2e tempest-CreateVolumesFromSourceVolumeTest-438771466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.412s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:07 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-79222d66-4fab-4bc6-9994-e24ea78eae2e tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:28:07 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-f63c55fe-2ead-464e-b3bd-1b05987a7f37 tempest-CreateVolumesFromSnapshotTest-846457304 None] Creating offline snapshot fb0d02ca-259c-4c84-9ed1-7c053583682b of volume 6d66b2ed-5636-4905-ba38-61575c04ad15 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:28:07 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-79222d66-4fab-4bc6-9994-e24ea78eae2e tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Deleted volume successfully. Nov 03 13:28:07 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[40069ec0-781e-4788-9dbf-5bfdcd924469]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f63c55fe-2ead-464e-b3bd-1b05987a7f37 tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:07 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-79222d66-4fab-4bc6-9994-e24ea78eae2e tempest-CreateVolumesFromSourceVolumeTest-438771466 None] Lock "cinder-68765115-991e-40da-b912-b8e76d1537ce-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:07 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15 Nov 03 13:28:07 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:08 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-74d80e39-2a77-4060-bc4e-c2bc207b8ba0 tempest-VolumeDependencyTests-154917658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78.786be806-ad9f-46e9-9cb9-571641abccb6" returned: 0 in 0.586s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:08 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-74d80e39-2a77-4060-bc4e-c2bc207b8ba0 tempest-VolumeDependencyTests-154917658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62ed0551-ac41-4162-83b3-09f7624dfe78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:28:08 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae0fd0a-4642-44ea-a1b1-e8d450ddf625]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-74d80e39-2a77-4060-bc4e-c2bc207b8ba0 tempest-VolumeDependencyTests-154917658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:08 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78 Nov 03 13:28:08 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:08 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f63c55fe-2ead-464e-b3bd-1b05987a7f37 tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15" returned: 0 in 0.465s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f63c55fe-2ead-464e-b3bd-1b05987a7f37 tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15.fb0d02ca-259c-4c84-9ed1-7c053583682b 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:08 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15.fb0d02ca-259c-4c84-9ed1-7c053583682b 1G Nov 03 13:28:08 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:08 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-74d80e39-2a77-4060-bc4e-c2bc207b8ba0 tempest-VolumeDependencyTests-154917658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78" returned: 0 in 0.703s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-74d80e39-2a77-4060-bc4e-c2bc207b8ba0 tempest-VolumeDependencyTests-154917658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78.786be806-ad9f-46e9-9cb9-571641abccb6 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:08 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78.786be806-ad9f-46e9-9cb9-571641abccb6 Nov 03 13:28:08 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:08 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f63c55fe-2ead-464e-b3bd-1b05987a7f37 tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15.fb0d02ca-259c-4c84-9ed1-7c053583682b 1G" returned: 0 in 0.558s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f63c55fe-2ead-464e-b3bd-1b05987a7f37 tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d66b2ed-5636-4905-ba38-61575c04ad15 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15.fb0d02ca-259c-4c84-9ed1-7c053583682b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:08 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d66b2ed-5636-4905-ba38-61575c04ad15 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15.fb0d02ca-259c-4c84-9ed1-7c053583682b Nov 03 13:28:08 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:09 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f63c55fe-2ead-464e-b3bd-1b05987a7f37 tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d66b2ed-5636-4905-ba38-61575c04ad15 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15.fb0d02ca-259c-4c84-9ed1-7c053583682b" returned: 0 in 0.334s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:09 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-f63c55fe-2ead-464e-b3bd-1b05987a7f37 tempest-CreateVolumesFromSnapshotTest-846457304 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15.fb0d02ca-259c-4c84-9ed1-7c053583682b is being set with open permissions: ugo+rw Nov 03 13:28:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f63c55fe-2ead-464e-b3bd-1b05987a7f37 tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15.fb0d02ca-259c-4c84-9ed1-7c053583682b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:09 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15.fb0d02ca-259c-4c84-9ed1-7c053583682b Nov 03 13:28:09 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:09 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-74d80e39-2a77-4060-bc4e-c2bc207b8ba0 tempest-VolumeDependencyTests-154917658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78.786be806-ad9f-46e9-9cb9-571641abccb6" returned: 0 in 0.467s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-74d80e39-2a77-4060-bc4e-c2bc207b8ba0 tempest-VolumeDependencyTests-154917658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78.786be806-ad9f-46e9-9cb9-571641abccb6 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:09 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78.786be806-ad9f-46e9-9cb9-571641abccb6 Nov 03 13:28:09 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:09 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f63c55fe-2ead-464e-b3bd-1b05987a7f37 tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15.fb0d02ca-259c-4c84-9ed1-7c053583682b" returned: 0 in 0.347s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:09 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f63c55fe-2ead-464e-b3bd-1b05987a7f37 tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-74d80e39-2a77-4060-bc4e-c2bc207b8ba0 tempest-VolumeDependencyTests-154917658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78.786be806-ad9f-46e9-9cb9-571641abccb6" returned: 0 in 0.349s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:09 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15.info Nov 03 13:28:09 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:09 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-74d80e39-2a77-4060-bc4e-c2bc207b8ba0 tempest-VolumeDependencyTests-154917658 None] Lock "cinder-quobyte-786be806-ad9f-46e9-9cb9-571641abccb6" released by "_delete_snapshot" :: held 2.241s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:09 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-74d80e39-2a77-4060-bc4e-c2bc207b8ba0 tempest-VolumeDependencyTests-154917658 None] Lock "cinder-quobyte-62ed0551-ac41-4162-83b3-09f7624dfe78" released by "delete_snapshot" :: held 2.267s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:09 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-74d80e39-2a77-4060-bc4e-c2bc207b8ba0 tempest-VolumeDependencyTests-154917658 None] Created reservations ['78619885-6bae-4e94-abd0-f60cf6e3c67f', '1c07b652-dfea-44c7-9429-6590483105f5', 'f55ded9c-bb4b-4a08-a363-b1ae40bcacbb', '5bd363c6-289e-456c-8c34-ec02200c37aa'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:09 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-74d80e39-2a77-4060-bc4e-c2bc207b8ba0 tempest-VolumeDependencyTests-154917658 None] Delete snapshot completed successfully. Nov 03 13:28:09 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-74d80e39-2a77-4060-bc4e-c2bc207b8ba0 tempest-VolumeDependencyTests-154917658 None] Lock "cinder-786be806-ad9f-46e9-9cb9-571641abccb6-delete_snapshot" released by "delete_snapshot" :: held 2.465s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:09 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8b6f32cf-cdec-42c8-a8b2-c79def5136d2 tempest-ProjectAdminTests-1292505728 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7062873840332, 'free_capacity_gb': 1773.7062873840332, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86725) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 13:28:09 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f63c55fe-2ead-464e-b3bd-1b05987a7f37 tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15.info" returned: 0 in 0.303s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:09 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-f63c55fe-2ead-464e-b3bd-1b05987a7f37 tempest-CreateVolumesFromSnapshotTest-846457304 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15.info is being set with open permissions: ugo+rw Nov 03 13:28:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f63c55fe-2ead-464e-b3bd-1b05987a7f37 tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:09 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15.info Nov 03 13:28:09 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:10 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f63c55fe-2ead-464e-b3bd-1b05987a7f37 tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15.info" returned: 0 in 0.268s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f63c55fe-2ead-464e-b3bd-1b05987a7f37 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.445s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:10 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-f63c55fe-2ead-464e-b3bd-1b05987a7f37 tempest-CreateVolumesFromSnapshotTest-846457304 None] Create snapshot completed successfully Nov 03 13:28:10 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d509b4be-76a5-40d9-8429-e749bf05382e tempest-VolumeDependencyTests-154917658 None] Acquiring lock "cinder-62ed0551-ac41-4162-83b3-09f7624dfe78-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:10 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d509b4be-76a5-40d9-8429-e749bf05382e tempest-VolumeDependencyTests-154917658 None] Lock "cinder-62ed0551-ac41-4162-83b3-09f7624dfe78-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:10 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d509b4be-76a5-40d9-8429-e749bf05382e tempest-VolumeDependencyTests-154917658 None] Acquiring lock "cinder-quobyte-62ed0551-ac41-4162-83b3-09f7624dfe78" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:10 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d509b4be-76a5-40d9-8429-e749bf05382e tempest-VolumeDependencyTests-154917658 None] Lock "cinder-quobyte-62ed0551-ac41-4162-83b3-09f7624dfe78" acquired by "delete_volume" :: waited 0.030s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:10 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c9781b-53e2-457c-9c5f-15cff218779b]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d509b4be-76a5-40d9-8429-e749bf05382e tempest-VolumeDependencyTests-154917658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:10 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78 Nov 03 13:28:10 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:11 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d509b4be-76a5-40d9-8429-e749bf05382e tempest-VolumeDependencyTests-154917658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78" returned: 0 in 0.507s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d509b4be-76a5-40d9-8429-e749bf05382e tempest-VolumeDependencyTests-154917658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:11 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78 Nov 03 13:28:11 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:11 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d509b4be-76a5-40d9-8429-e749bf05382e tempest-VolumeDependencyTests-154917658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62ed0551-ac41-4162-83b3-09f7624dfe78" returned: 0 in 0.347s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:11 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d509b4be-76a5-40d9-8429-e749bf05382e tempest-VolumeDependencyTests-154917658 None] Lock "cinder-quobyte-62ed0551-ac41-4162-83b3-09f7624dfe78" released by "delete_volume" :: held 0.949s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:11 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-d509b4be-76a5-40d9-8429-e749bf05382e tempest-VolumeDependencyTests-154917658 None] Created reservations ['46221aa6-7521-4ff4-8b22-4db79fef37b5', 'df0591a4-e262-4bca-9f91-cd2664198f3b', 'c5bcfea0-2722-4d0b-bfcb-98eb995a2dcd', '2d201eb5-8220-4a05-bf54-e1895c43cde6'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d509b4be-76a5-40d9-8429-e749bf05382e tempest-VolumeDependencyTests-154917658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d509b4be-76a5-40d9-8429-e749bf05382e tempest-VolumeDependencyTests-154917658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:11 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d509b4be-76a5-40d9-8429-e749bf05382e tempest-VolumeDependencyTests-154917658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:11 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d509b4be-76a5-40d9-8429-e749bf05382e tempest-VolumeDependencyTests-154917658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d509b4be-76a5-40d9-8429-e749bf05382e tempest-VolumeDependencyTests-154917658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d509b4be-76a5-40d9-8429-e749bf05382e tempest-VolumeDependencyTests-154917658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:11 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:28:11 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:11 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a84425eb-7467-477a-892a-88c546ed482f tempest-VolumeDependencyTests-154917658 None] Acquiring lock "cinder-70a9187d-0b40-4c3a-89bb-67790cebec3d-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:11 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:28:11 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] Flow 'volume_create_manager' (2a14cfd4-4574-49e2-9f5f-909ad8c6d748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:11 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d5dede3-882d-4e4e-aa0f-9807ec40d4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:11 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a84425eb-7467-477a-892a-88c546ed482f tempest-VolumeDependencyTests-154917658 None] Lock "cinder-70a9187d-0b40-4c3a-89bb-67790cebec3d-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d5dede3-882d-4e4e-aa0f-9807ec40d4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1031804537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c0fd963-e7eb-4af5-94b1-5f54f3a6713e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12163086a4d645fab0abd4f6b20a5b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:12Z,use_quota=True,user_id='6860d03379374f96bd09921865d5bbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f989bebe-0194-4ef3-9130-30c3fe4a4fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f989bebe-0194-4ef3-9130-30c3fe4a4fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b8c14e-c3cc-4587-91f6-f335651b9f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b8c14e-c3cc-4587-91f6-f335651b9f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c0fd963-e7eb-4af5-94b1-5f54f3a6713e', 'volume_name': 'volume-7c0fd963-e7eb-4af5-94b1-5f54f3a6713e', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95aa6050-1516-4945-862d-4e28e8b387a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95aa6050-1516-4945-862d-4e28e8b387a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d458428-cbb5-4705-aa8b-0fd5836106d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:12 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] Volume 7c0fd963-e7eb-4af5-94b1-5f54f3a6713e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c0fd963-e7eb-4af5-94b1-5f54f3a6713e', 'volume_size': 1} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1031804537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c0fd963-e7eb-4af5-94b1-5f54f3a6713e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12163086a4d645fab0abd4f6b20a5b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:12Z,use_quota=True,user_id='6860d03379374f96bd09921865d5bbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] Creating volume 7c0fd963-e7eb-4af5-94b1-5f54f3a6713e {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:28:12 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7c0fd963-e7eb-4af5-94b1-5f54f3a6713e 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a84425eb-7467-477a-892a-88c546ed482f tempest-VolumeDependencyTests-154917658 None] Acquiring lock "cinder-quobyte-70a9187d-0b40-4c3a-89bb-67790cebec3d" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a84425eb-7467-477a-892a-88c546ed482f tempest-VolumeDependencyTests-154917658 None] Lock "cinder-quobyte-70a9187d-0b40-4c3a-89bb-67790cebec3d" acquired by "delete_volume" :: waited 0.021s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:12 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7c0fd963-e7eb-4af5-94b1-5f54f3a6713e 1073741824 Nov 03 13:28:12 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[7413fd49-3ffc-45f7-b39a-f5bee2698e4b]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a84425eb-7467-477a-892a-88c546ed482f tempest-VolumeDependencyTests-154917658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-70a9187d-0b40-4c3a-89bb-67790cebec3d {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:12 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d509b4be-76a5-40d9-8429-e749bf05382e tempest-VolumeDependencyTests-154917658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.500s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-d509b4be-76a5-40d9-8429-e749bf05382e tempest-VolumeDependencyTests-154917658 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:28:12 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-d509b4be-76a5-40d9-8429-e749bf05382e tempest-VolumeDependencyTests-154917658 None] Deleted volume successfully. Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] Flow 'volume_create_manager' (2e40177c-45b1-4754-989f-ffc8b2cf9c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52372439-5385-44ca-8fe6-20b95dadc242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52372439-5385-44ca-8fe6-20b95dadc242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0122d764-73c5-44a0-83be-63695dfbe942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='256b4c41d2c2400794c06452ec304e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:12Z,use_quota=True,user_id='83a2d94caafa43158ec51df9d726d5d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6b0f595-206f-455c-b4ef-5cf733ad08b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6b0f595-206f-455c-b4ef-5cf733ad08b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:12 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-70a9187d-0b40-4c3a-89bb-67790cebec3d Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c910a50-c5c1-42a6-83d4-ccb31b4063e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:12 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c910a50-c5c1-42a6-83d4-ccb31b4063e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0122d764-73c5-44a0-83be-63695dfbe942', 'volume_name': 'volume-0122d764-73c5-44a0-83be-63695dfbe942', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (938526c6-f61f-4e85-a5dc-d677e962aac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (938526c6-f61f-4e85-a5dc-d677e962aac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a4f564f-9493-40a7-84b7-26d3a791942e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:12 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] Volume 0122d764-73c5-44a0-83be-63695dfbe942: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0122d764-73c5-44a0-83be-63695dfbe942', 'volume_size': 1} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d509b4be-76a5-40d9-8429-e749bf05382e tempest-VolumeDependencyTests-154917658 None] Lock "cinder-62ed0551-ac41-4162-83b3-09f7624dfe78-delete_volume" released by "delete_volume" :: held 1.962s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] Flow 'volume_create_manager' (3760a17e-d5a6-4bb5-a49d-4d52d4262c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb8c9fc-92c7-438f-bc47-758b4f124bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb8c9fc-92c7-438f-bc47-758b4f124bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-395168271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cae1fc20-d846-4440-afc0-84e18ace7571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12163086a4d645fab0abd4f6b20a5b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:13Z,use_quota=True,user_id='6860d03379374f96bd09921865d5bbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c675a0d-4fec-4066-9982-e5aeec583e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c675a0d-4fec-4066-9982-e5aeec583e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:12 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbbf98c9-60a1-490d-9b9c-94b3bb95a124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:12 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbbf98c9-60a1-490d-9b9c-94b3bb95a124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cae1fc20-d846-4440-afc0-84e18ace7571', 'volume_name': 'volume-cae1fc20-d846-4440-afc0-84e18ace7571', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d2fce3-5866-4408-8717-89f147ab7180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d2fce3-5866-4408-8717-89f147ab7180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d1b43b8-3740-4a63-8aee-4daaf39c3650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:12 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] Volume cae1fc20-d846-4440-afc0-84e18ace7571: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cae1fc20-d846-4440-afc0-84e18ace7571', 'volume_size': 1} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a84425eb-7467-477a-892a-88c546ed482f tempest-VolumeDependencyTests-154917658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-70a9187d-0b40-4c3a-89bb-67790cebec3d" returned: 0 in 0.701s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7c0fd963-e7eb-4af5-94b1-5f54f3a6713e 1073741824" returned: 0 in 0.811s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a84425eb-7467-477a-892a-88c546ed482f tempest-VolumeDependencyTests-154917658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-70a9187d-0b40-4c3a-89bb-67790cebec3d {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:12 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-70a9187d-0b40-4c3a-89bb-67790cebec3d Nov 03 13:28:12 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7c0fd963-e7eb-4af5-94b1-5f54f3a6713e {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:12 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7c0fd963-e7eb-4af5-94b1-5f54f3a6713e Nov 03 13:28:12 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Flow 'volume_create_manager' (01d31ab0-5d1c-4eb0-9769-14628bb72592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (465da9d0-2182-47ab-a212-48bdaadfb37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (465da9d0-2182-47ab-a212-48bdaadfb37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1413337030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66a63cd9-ddd2-4820-aa72-dd6c51a03745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12163086a4d645fab0abd4f6b20a5b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:13Z,use_quota=True,user_id='6860d03379374f96bd09921865d5bbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4a97af4-04c6-41d1-8171-85151bd2e0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4a97af4-04c6-41d1-8171-85151bd2e0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e57f13c-5e7e-4a12-9d94-1d1a3259c484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e57f13c-5e7e-4a12-9d94-1d1a3259c484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66a63cd9-ddd2-4820-aa72-dd6c51a03745', 'volume_name': 'volume-66a63cd9-ddd2-4820-aa72-dd6c51a03745', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579fa0ff-b195-43de-9fa7-13cbfa7da059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579fa0ff-b195-43de-9fa7-13cbfa7da059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5093d4f-2901-4f35-b690-031b979b6e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:13 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Volume 66a63cd9-ddd2-4820-aa72-dd6c51a03745: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66a63cd9-ddd2-4820-aa72-dd6c51a03745', 'volume_size': 1} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:13 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a84425eb-7467-477a-892a-88c546ed482f tempest-VolumeDependencyTests-154917658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-70a9187d-0b40-4c3a-89bb-67790cebec3d" returned: 0 in 0.450s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:13 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7c0fd963-e7eb-4af5-94b1-5f54f3a6713e" returned: 0 in 0.420s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.878s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0122d764-73c5-44a0-83be-63695dfbe942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='256b4c41d2c2400794c06452ec304e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:12Z,use_quota=True,user_id='83a2d94caafa43158ec51df9d726d5d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] Creating volume 0122d764-73c5-44a0-83be-63695dfbe942 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:28:13 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0122d764-73c5-44a0-83be-63695dfbe942 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a84425eb-7467-477a-892a-88c546ed482f tempest-VolumeDependencyTests-154917658 None] Lock "cinder-quobyte-70a9187d-0b40-4c3a-89bb-67790cebec3d" released by "delete_volume" :: held 1.270s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:13 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0122d764-73c5-44a0-83be-63695dfbe942 1073741824 Nov 03 13:28:13 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d458428-cbb5-4705-aa8b-0fd5836106d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c0fd963-e7eb-4af5-94b1-5f54f3a6713e', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb80707e-ace3-460f-ae6b-63086e0e085f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:13 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] Volume volume-7c0fd963-e7eb-4af5-94b1-5f54f3a6713e (7c0fd963-e7eb-4af5-94b1-5f54f3a6713e): created successfully Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb80707e-ace3-460f-ae6b-63086e0e085f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] Flow 'volume_create_manager' (2a14cfd4-4574-49e2-9f5f-909ad8c6d748) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:13 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-3dbf6d2d-4870-4156-b6f7-58c222e44c53 tempest-CreateVolumesFromSnapshotTest-846457304 None] Created volume successfully. Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] Flow 'volume_create_manager' (aa4249e2-5e0c-4526-a8e4-311c8a0ae5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22d31e7a-521f-464f-8234-939235b75a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22d31e7a-521f-464f-8234-939235b75a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1173201549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54f5f7d8-f66d-462d-a9e0-82b6531f01ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12163086a4d645fab0abd4f6b20a5b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:13Z,use_quota=True,user_id='6860d03379374f96bd09921865d5bbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c242e17-c9b5-4e46-bb30-127ee7290946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c242e17-c9b5-4e46-bb30-127ee7290946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b09de2b1-3610-4ca5-9060-4e545d07a5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b09de2b1-3610-4ca5-9060-4e545d07a5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54f5f7d8-f66d-462d-a9e0-82b6531f01ef', 'volume_name': 'volume-54f5f7d8-f66d-462d-a9e0-82b6531f01ef', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af25db5-ba57-43df-aa61-225d8b539b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af25db5-ba57-43df-aa61-225d8b539b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbafac70-1aed-4ecf-aec7-46ca94db8c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:13 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] Volume 54f5f7d8-f66d-462d-a9e0-82b6531f01ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54f5f7d8-f66d-462d-a9e0-82b6531f01ef', 'volume_size': 1} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-a84425eb-7467-477a-892a-88c546ed482f tempest-VolumeDependencyTests-154917658 None] Created reservations ['c16a3e4c-d8f8-47b6-a65b-8e95184620ea', '8f71ad4b-7478-4202-bdab-e451ed6d9e82', '300c8226-ad44-4194-987c-53d9ac323da5', '14966b1a-0bf5-4e89-b8e6-37a238fc546c'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a84425eb-7467-477a-892a-88c546ed482f tempest-VolumeDependencyTests-154917658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a84425eb-7467-477a-892a-88c546ed482f tempest-VolumeDependencyTests-154917658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a84425eb-7467-477a-892a-88c546ed482f tempest-VolumeDependencyTests-154917658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a84425eb-7467-477a-892a-88c546ed482f tempest-VolumeDependencyTests-154917658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a84425eb-7467-477a-892a-88c546ed482f tempest-VolumeDependencyTests-154917658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a84425eb-7467-477a-892a-88c546ed482f tempest-VolumeDependencyTests-154917658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:13 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:28:13 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] Flow 'volume_create_manager' (a743c603-4954-4a76-b6d3-b8d9e9ae1227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da073fc3-947d-44d1-8e98-ada0f7ad3fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da073fc3-947d-44d1-8e98-ada0f7ad3fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1101754830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62cb21ca-1c5e-4677-b135-41560dc5d9fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12163086a4d645fab0abd4f6b20a5b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:14Z,use_quota=True,user_id='6860d03379374f96bd09921865d5bbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:13 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda4876e-08b2-4add-bf9f-29fda444fbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda4876e-08b2-4add-bf9f-29fda444fbee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b344e8c6-19e6-4c82-bee8-3ba6daa2bb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b344e8c6-19e6-4c82-bee8-3ba6daa2bb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62cb21ca-1c5e-4677-b135-41560dc5d9fd', 'volume_name': 'volume-62cb21ca-1c5e-4677-b135-41560dc5d9fd', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (687bf689-f7f7-4c67-bb1a-54e67f54a6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (687bf689-f7f7-4c67-bb1a-54e67f54a6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f2877f2-0d9c-4cbb-a2fe-858d64dc35bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:14 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] Volume 62cb21ca-1c5e-4677-b135-41560dc5d9fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62cb21ca-1c5e-4677-b135-41560dc5d9fd', 'volume_size': 1} Nov 03 13:28:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:14 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0122d764-73c5-44a0-83be-63695dfbe942 1073741824" returned: 0 in 0.700s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0122d764-73c5-44a0-83be-63695dfbe942 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:14 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0122d764-73c5-44a0-83be-63695dfbe942 Nov 03 13:28:14 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:14 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a84425eb-7467-477a-892a-88c546ed482f tempest-VolumeDependencyTests-154917658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.326s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:14 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-a84425eb-7467-477a-892a-88c546ed482f tempest-VolumeDependencyTests-154917658 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:28:14 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-a84425eb-7467-477a-892a-88c546ed482f tempest-VolumeDependencyTests-154917658 None] Deleted volume successfully. Nov 03 13:28:14 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a84425eb-7467-477a-892a-88c546ed482f tempest-VolumeDependencyTests-154917658 None] Lock "cinder-70a9187d-0b40-4c3a-89bb-67790cebec3d-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:14 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0122d764-73c5-44a0-83be-63695dfbe942" returned: 0 in 0.299s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:14 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:28:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.536s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:14 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-395168271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cae1fc20-d846-4440-afc0-84e18ace7571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12163086a4d645fab0abd4f6b20a5b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:13Z,use_quota=True,user_id='6860d03379374f96bd09921865d5bbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:28:14 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] Creating volume cae1fc20-d846-4440-afc0-84e18ace7571 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:28:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:14 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:14 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:14 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:28:14 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:28:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cae1fc20-d846-4440-afc0-84e18ace7571 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a4f564f-9493-40a7-84b7-26d3a791942e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0122d764-73c5-44a0-83be-63695dfbe942', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:14 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cae1fc20-d846-4440-afc0-84e18ace7571 1073741824 Nov 03 13:28:14 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13059f8d-b75f-49f7-8e09-d574355c0511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:14 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] Volume volume-0122d764-73c5-44a0-83be-63695dfbe942 (0122d764-73c5-44a0-83be-63695dfbe942): created successfully Nov 03 13:28:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13059f8d-b75f-49f7-8e09-d574355c0511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:14 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] Flow 'volume_create_manager' (2e40177c-45b1-4754-989f-ffc8b2cf9c23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:14 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-ad16cdc7-1cf9-4a3c-924e-26e58e9dabfe tempest-CinderUnicodeTest-1843347469 None] Created volume successfully. Nov 03 13:28:14 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cae1fc20-d846-4440-afc0-84e18ace7571 1073741824" returned: 0 in 0.535s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cae1fc20-d846-4440-afc0-84e18ace7571 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:15 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cae1fc20-d846-4440-afc0-84e18ace7571 Nov 03 13:28:15 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:15 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cae1fc20-d846-4440-afc0-84e18ace7571" returned: 0 in 0.384s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:15 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:28:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.128s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:15 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1413337030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66a63cd9-ddd2-4820-aa72-dd6c51a03745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12163086a4d645fab0abd4f6b20a5b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:13Z,use_quota=True,user_id='6860d03379374f96bd09921865d5bbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:28:15 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Creating volume 66a63cd9-ddd2-4820-aa72-dd6c51a03745 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:28:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:15 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:15 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:15 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:28:15 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:28:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66a63cd9-ddd2-4820-aa72-dd6c51a03745 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:15 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d1b43b8-3740-4a63-8aee-4daaf39c3650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cae1fc20-d846-4440-afc0-84e18ace7571', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:15 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a32710c-a199-4e01-a4e4-ca8d32d6c0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:15 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66a63cd9-ddd2-4820-aa72-dd6c51a03745 1073741824 Nov 03 13:28:15 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:15 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] Volume volume-cae1fc20-d846-4440-afc0-84e18ace7571 (cae1fc20-d846-4440-afc0-84e18ace7571): created successfully Nov 03 13:28:15 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a32710c-a199-4e01-a4e4-ca8d32d6c0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:15 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] Flow 'volume_create_manager' (3760a17e-d5a6-4bb5-a49d-4d52d4262c1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:15 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-a9333b27-14fb-4f6c-b7d2-05acadc7b611 tempest-CreateVolumesFromSnapshotTest-846457304 None] Created volume successfully. Nov 03 13:28:15 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:28:15 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] Flow 'volume_create_manager' (66345665-f66f-4d01-94be-4f3f7517e438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:15 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d7ffe64-930f-447e-954a-7c1ba9843135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d7ffe64-930f-447e-954a-7c1ba9843135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1911966343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1781a6b3-95dc-4426-8201-7749cc1d1265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='256b4c41d2c2400794c06452ec304e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:16Z,use_quota=True,user_id='83a2d94caafa43158ec51df9d726d5d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0c7564-9db2-4dde-a55e-d726e5fa9242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0c7564-9db2-4dde-a55e-d726e5fa9242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e26ff2-7b1f-4b9a-8126-d95824dd25f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e26ff2-7b1f-4b9a-8126-d95824dd25f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1781a6b3-95dc-4426-8201-7749cc1d1265', 'volume_name': 'volume-1781a6b3-95dc-4426-8201-7749cc1d1265', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b6625d-4f68-4fab-9b6f-a9619cad9349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b6625d-4f68-4fab-9b6f-a9619cad9349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96db55e1-343a-4c9c-8692-a6e55b21c36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:16 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] Volume 1781a6b3-95dc-4426-8201-7749cc1d1265: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1781a6b3-95dc-4426-8201-7749cc1d1265', 'volume_size': 1} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:16 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66a63cd9-ddd2-4820-aa72-dd6c51a03745 1073741824" returned: 0 in 0.783s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] Flow 'volume_create_manager' (d88b773b-bba8-4053-a36d-5b9ffc1834bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b290e040-181f-4de7-a581-1602f3ec1367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b290e040-181f-4de7-a581-1602f3ec1367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-15675607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60ac3b296fa402ebc45563747540073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:16Z,use_quota=True,user_id='82e28082879940beb510c24ff3452f75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5780e204-029b-48fe-9d5e-957171572f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5780e204-029b-48fe-9d5e-957171572f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea538a4c-738c-47b9-be47-06212f973bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea538a4c-738c-47b9-be47-06212f973bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310', 'volume_name': 'volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df506b82-eaa3-40c2-ad03-a3062bc6bc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df506b82-eaa3-40c2-ad03-a3062bc6bc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd1e603-8d3b-47e5-af42-a8551c53b905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:16 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] Volume 27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310', 'volume_size': 1} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66a63cd9-ddd2-4820-aa72-dd6c51a03745 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:16 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66a63cd9-ddd2-4820-aa72-dd6c51a03745 Nov 03 13:28:16 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:16 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66a63cd9-ddd2-4820-aa72-dd6c51a03745" returned: 0 in 0.258s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.849s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1173201549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54f5f7d8-f66d-462d-a9e0-82b6531f01ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12163086a4d645fab0abd4f6b20a5b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:13Z,use_quota=True,user_id='6860d03379374f96bd09921865d5bbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] Creating volume 54f5f7d8-f66d-462d-a9e0-82b6531f01ef {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:28:16 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-54f5f7d8-f66d-462d-a9e0-82b6531f01ef 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5093d4f-2901-4f35-b690-031b979b6e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66a63cd9-ddd2-4820-aa72-dd6c51a03745', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:16 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-54f5f7d8-f66d-462d-a9e0-82b6531f01ef 1073741824 Nov 03 13:28:16 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40c27c2f-779b-4fe2-9176-98dd301406ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:16 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Volume volume-66a63cd9-ddd2-4820-aa72-dd6c51a03745 (66a63cd9-ddd2-4820-aa72-dd6c51a03745): created successfully Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40c27c2f-779b-4fe2-9176-98dd301406ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:16 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Flow 'volume_create_manager' (01d31ab0-5d1c-4eb0-9769-14628bb72592) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:16 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-2fe16a73-9be7-485d-9b8c-bc9cc1a9bff5 tempest-CreateVolumesFromSnapshotTest-846457304 None] Created volume successfully. Nov 03 13:28:17 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-54f5f7d8-f66d-462d-a9e0-82b6531f01ef 1073741824" returned: 0 in 0.465s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-54f5f7d8-f66d-462d-a9e0-82b6531f01ef {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:17 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-54f5f7d8-f66d-462d-a9e0-82b6531f01ef Nov 03 13:28:17 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:17 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-54f5f7d8-f66d-462d-a9e0-82b6531f01ef" returned: 0 in 0.254s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:17 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:28:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.341s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:17 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1101754830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62cb21ca-1c5e-4677-b135-41560dc5d9fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12163086a4d645fab0abd4f6b20a5b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:14Z,use_quota=True,user_id='6860d03379374f96bd09921865d5bbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:28:17 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] Creating volume 62cb21ca-1c5e-4677-b135-41560dc5d9fd {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:28:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:17 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:17 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:17 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:28:17 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:28:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62cb21ca-1c5e-4677-b135-41560dc5d9fd 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:17 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbafac70-1aed-4ecf-aec7-46ca94db8c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54f5f7d8-f66d-462d-a9e0-82b6531f01ef', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:17 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62cb21ca-1c5e-4677-b135-41560dc5d9fd 1073741824 Nov 03 13:28:17 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:17 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e0a1cb-4867-4a4b-8f36-a5b9ce0489e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:17 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] Volume volume-54f5f7d8-f66d-462d-a9e0-82b6531f01ef (54f5f7d8-f66d-462d-a9e0-82b6531f01ef): created successfully Nov 03 13:28:17 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e0a1cb-4867-4a4b-8f36-a5b9ce0489e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:17 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] Flow 'volume_create_manager' (aa4249e2-5e0c-4526-a8e4-311c8a0ae5fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:17 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-4147856a-c755-417d-ad7d-3fe9d22116aa tempest-CreateVolumesFromSnapshotTest-846457304 None] Created volume successfully. Nov 03 13:28:17 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62cb21ca-1c5e-4677-b135-41560dc5d9fd 1073741824" returned: 0 in 0.437s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62cb21ca-1c5e-4677-b135-41560dc5d9fd {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:17 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62cb21ca-1c5e-4677-b135-41560dc5d9fd Nov 03 13:28:17 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:18 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62cb21ca-1c5e-4677-b135-41560dc5d9fd" returned: 0 in 0.256s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.055s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1911966343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1781a6b3-95dc-4426-8201-7749cc1d1265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='256b4c41d2c2400794c06452ec304e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:16Z,use_quota=True,user_id='83a2d94caafa43158ec51df9d726d5d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] Creating volume 1781a6b3-95dc-4426-8201-7749cc1d1265 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:28:18 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f2877f2-0d9c-4cbb-a2fe-858d64dc35bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62cb21ca-1c5e-4677-b135-41560dc5d9fd', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:18 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265 1073741824 Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16acbc38-ef8b-436d-a6a3-7647f19851f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:18 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:18 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] Volume volume-62cb21ca-1c5e-4677-b135-41560dc5d9fd (62cb21ca-1c5e-4677-b135-41560dc5d9fd): created successfully Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16acbc38-ef8b-436d-a6a3-7647f19851f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] Flow 'volume_create_manager' (a743c603-4954-4a76-b6d3-b8d9e9ae1227) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:18 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-74b5dc46-760e-481a-ad75-c3e261d3b56a tempest-CreateVolumesFromSnapshotTest-846457304 None] Created volume successfully. Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9902a446-cbe9-43d8-b367-7c443f7b61c2 tempest-CreateVolumesFromSnapshotTest-846457304 None] Acquiring lock "cinder-62cb21ca-1c5e-4677-b135-41560dc5d9fd-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9902a446-cbe9-43d8-b367-7c443f7b61c2 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "cinder-62cb21ca-1c5e-4677-b135-41560dc5d9fd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9902a446-cbe9-43d8-b367-7c443f7b61c2 tempest-CreateVolumesFromSnapshotTest-846457304 None] Acquiring lock "cinder-quobyte-62cb21ca-1c5e-4677-b135-41560dc5d9fd" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9902a446-cbe9-43d8-b367-7c443f7b61c2 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "cinder-quobyte-62cb21ca-1c5e-4677-b135-41560dc5d9fd" acquired by "delete_volume" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba2919f-3d10-4ebb-b828-843dbec9e90f]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9902a446-cbe9-43d8-b367-7c443f7b61c2 tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62cb21ca-1c5e-4677-b135-41560dc5d9fd {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:18 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265 1073741824" returned: 0 in 0.532s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:18 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265 Nov 03 13:28:18 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:18 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62cb21ca-1c5e-4677-b135-41560dc5d9fd Nov 03 13:28:18 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:18 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265" returned: 0 in 0.281s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.658s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-15675607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60ac3b296fa402ebc45563747540073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:16Z,use_quota=True,user_id='82e28082879940beb510c24ff3452f75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] Creating volume 27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:28:19 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:19 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96db55e1-343a-4c9c-8692-a6e55b21c36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1781a6b3-95dc-4426-8201-7749cc1d1265', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cbccb56-b2de-4742-ac5b-edc1cc378512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:19 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310 1073741824 Nov 03 13:28:19 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9902a446-cbe9-43d8-b367-7c443f7b61c2 tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62cb21ca-1c5e-4677-b135-41560dc5d9fd" returned: 0 in 0.430s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9902a446-cbe9-43d8-b367-7c443f7b61c2 tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62cb21ca-1c5e-4677-b135-41560dc5d9fd {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:19 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] Volume volume-1781a6b3-95dc-4426-8201-7749cc1d1265 (1781a6b3-95dc-4426-8201-7749cc1d1265): created successfully Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cbccb56-b2de-4742-ac5b-edc1cc378512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] Flow 'volume_create_manager' (66345665-f66f-4d01-94be-4f3f7517e438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:19 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62cb21ca-1c5e-4677-b135-41560dc5d9fd Nov 03 13:28:19 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:19 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-f8361d55-02bf-4f1f-b92c-3c92cbd3cca4 tempest-CinderUnicodeTest-1843347469 None] Created volume successfully. Nov 03 13:28:19 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9902a446-cbe9-43d8-b367-7c443f7b61c2 tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-62cb21ca-1c5e-4677-b135-41560dc5d9fd" returned: 0 in 0.302s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9902a446-cbe9-43d8-b367-7c443f7b61c2 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "cinder-quobyte-62cb21ca-1c5e-4677-b135-41560dc5d9fd" released by "delete_volume" :: held 0.785s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-9902a446-cbe9-43d8-b367-7c443f7b61c2 tempest-CreateVolumesFromSnapshotTest-846457304 None] Created reservations ['80c26579-b2be-44ed-8e30-bba83832dd0e', '68c2b003-ad43-4d67-b5af-2f3827ffbe4e', 'bbfad748-f6a4-41af-982c-1e5e57bf16c7', 'e9fcb66f-f64f-4e50-a5a0-64f7afa05538'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9902a446-cbe9-43d8-b367-7c443f7b61c2 tempest-CreateVolumesFromSnapshotTest-846457304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9902a446-cbe9-43d8-b367-7c443f7b61c2 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-9902a446-cbe9-43d8-b367-7c443f7b61c2 tempest-CreateVolumesFromSnapshotTest-846457304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-9902a446-cbe9-43d8-b367-7c443f7b61c2 tempest-CreateVolumesFromSnapshotTest-846457304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9902a446-cbe9-43d8-b367-7c443f7b61c2 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9902a446-cbe9-43d8-b367-7c443f7b61c2 tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:19 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310 1073741824" returned: 0 in 0.536s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:19 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:28:19 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:19 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310 Nov 03 13:28:19 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-430c9e56-5978-40fa-b320-2bdf099479f3 tempest-CreateVolumesFromSnapshotTest-846457304 None] Acquiring lock "cinder-54f5f7d8-f66d-462d-a9e0-82b6531f01ef-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-430c9e56-5978-40fa-b320-2bdf099479f3 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "cinder-54f5f7d8-f66d-462d-a9e0-82b6531f01ef-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-430c9e56-5978-40fa-b320-2bdf099479f3 tempest-CreateVolumesFromSnapshotTest-846457304 None] Acquiring lock "cinder-quobyte-54f5f7d8-f66d-462d-a9e0-82b6531f01ef" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-430c9e56-5978-40fa-b320-2bdf099479f3 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "cinder-quobyte-54f5f7d8-f66d-462d-a9e0-82b6531f01ef" acquired by "delete_volume" :: waited 0.027s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:19 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9902a446-cbe9-43d8-b367-7c443f7b61c2 tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.326s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-9902a446-cbe9-43d8-b367-7c443f7b61c2 tempest-CreateVolumesFromSnapshotTest-846457304 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf163b6-fdae-4414-bf28-0cf7783d3a5f]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:19 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-9902a446-cbe9-43d8-b367-7c443f7b61c2 tempest-CreateVolumesFromSnapshotTest-846457304 None] Deleted volume successfully. Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-430c9e56-5978-40fa-b320-2bdf099479f3 tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-54f5f7d8-f66d-462d-a9e0-82b6531f01ef {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9902a446-cbe9-43d8-b367-7c443f7b61c2 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "cinder-62cb21ca-1c5e-4677-b135-41560dc5d9fd-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:19 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310" returned: 0 in 0.332s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd1e603-8d3b-47e5-af42-a8551c53b905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff78f621-ab17-47e5-ac90-9838aacb1750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:19 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] Volume volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310 (27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310): created successfully Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff78f621-ab17-47e5-ac90-9838aacb1750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:19 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] Flow 'volume_create_manager' (d88b773b-bba8-4053-a36d-5b9ffc1834bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:19 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-fff90219-3a47-421d-ba99-0c1ad642c66d tempest-ProjectMemberTests-1676407320 None] Created volume successfully. Nov 03 13:28:20 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-54f5f7d8-f66d-462d-a9e0-82b6531f01ef Nov 03 13:28:20 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:20 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-430c9e56-5978-40fa-b320-2bdf099479f3 tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-54f5f7d8-f66d-462d-a9e0-82b6531f01ef" returned: 0 in 0.485s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-430c9e56-5978-40fa-b320-2bdf099479f3 tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-54f5f7d8-f66d-462d-a9e0-82b6531f01ef {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:20 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-54f5f7d8-f66d-462d-a9e0-82b6531f01ef Nov 03 13:28:20 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-194fec39-bfae-4466-adfa-7187fa55b98c tempest-CinderUnicodeTest-1843347469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-194fec39-bfae-4466-adfa-7187fa55b98c tempest-CinderUnicodeTest-1843347469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:20 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-194fec39-bfae-4466-adfa-7187fa55b98c tempest-CinderUnicodeTest-1843347469 None] Creating offline snapshot bdd1622f-adbb-4bf0-9ef1-9007afe2c4fa of volume 1781a6b3-95dc-4426-8201-7749cc1d1265 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:28:20 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9ec19e-f7b2-4403-b788-da777b268140]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-194fec39-bfae-4466-adfa-7187fa55b98c tempest-CinderUnicodeTest-1843347469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:20 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-430c9e56-5978-40fa-b320-2bdf099479f3 tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-54f5f7d8-f66d-462d-a9e0-82b6531f01ef" returned: 0 in 0.381s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:20 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265 Nov 03 13:28:20 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:20 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-430c9e56-5978-40fa-b320-2bdf099479f3 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "cinder-quobyte-54f5f7d8-f66d-462d-a9e0-82b6531f01ef" released by "delete_volume" :: held 0.935s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:20 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-430c9e56-5978-40fa-b320-2bdf099479f3 tempest-CreateVolumesFromSnapshotTest-846457304 None] Created reservations ['7e74cff0-0789-4825-af97-de08c2571379', '46f8f274-9bff-41ed-951b-cedc026ae3e8', '313fcd13-791b-4e33-9b57-0615ccdfc610', '72617555-6882-47c6-83fc-ea92066fb00c'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-430c9e56-5978-40fa-b320-2bdf099479f3 tempest-CreateVolumesFromSnapshotTest-846457304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-430c9e56-5978-40fa-b320-2bdf099479f3 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:20 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-430c9e56-5978-40fa-b320-2bdf099479f3 tempest-CreateVolumesFromSnapshotTest-846457304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:20 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-430c9e56-5978-40fa-b320-2bdf099479f3 tempest-CreateVolumesFromSnapshotTest-846457304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-430c9e56-5978-40fa-b320-2bdf099479f3 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-430c9e56-5978-40fa-b320-2bdf099479f3 tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:21 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:28:21 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-efa6bb0c-0ed4-4eb2-b2bf-d3c513b9c54b tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:21 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-194fec39-bfae-4466-adfa-7187fa55b98c tempest-CinderUnicodeTest-1843347469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265" returned: 0 in 0.543s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-194fec39-bfae-4466-adfa-7187fa55b98c tempest-CinderUnicodeTest-1843347469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265.bdd1622f-adbb-4bf0-9ef1-9007afe2c4fa 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:21 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265.bdd1622f-adbb-4bf0-9ef1-9007afe2c4fa 1G Nov 03 13:28:21 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:21 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-430c9e56-5978-40fa-b320-2bdf099479f3 tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.317s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:21 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-430c9e56-5978-40fa-b320-2bdf099479f3 tempest-CreateVolumesFromSnapshotTest-846457304 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:28:21 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-430c9e56-5978-40fa-b320-2bdf099479f3 tempest-CreateVolumesFromSnapshotTest-846457304 None] Deleted volume successfully. Nov 03 13:28:21 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-430c9e56-5978-40fa-b320-2bdf099479f3 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "cinder-54f5f7d8-f66d-462d-a9e0-82b6531f01ef-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:21 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-194fec39-bfae-4466-adfa-7187fa55b98c tempest-CinderUnicodeTest-1843347469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265.bdd1622f-adbb-4bf0-9ef1-9007afe2c4fa 1G" returned: 0 in 0.505s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-194fec39-bfae-4466-adfa-7187fa55b98c tempest-CinderUnicodeTest-1843347469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1781a6b3-95dc-4426-8201-7749cc1d1265 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265.bdd1622f-adbb-4bf0-9ef1-9007afe2c4fa {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:21 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1781a6b3-95dc-4426-8201-7749cc1d1265 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265.bdd1622f-adbb-4bf0-9ef1-9007afe2c4fa Nov 03 13:28:21 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:21 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-194fec39-bfae-4466-adfa-7187fa55b98c tempest-CinderUnicodeTest-1843347469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1781a6b3-95dc-4426-8201-7749cc1d1265 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265.bdd1622f-adbb-4bf0-9ef1-9007afe2c4fa" returned: 0 in 0.326s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:21 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-194fec39-bfae-4466-adfa-7187fa55b98c tempest-CinderUnicodeTest-1843347469 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265.bdd1622f-adbb-4bf0-9ef1-9007afe2c4fa is being set with open permissions: ugo+rw Nov 03 13:28:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-194fec39-bfae-4466-adfa-7187fa55b98c tempest-CinderUnicodeTest-1843347469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265.bdd1622f-adbb-4bf0-9ef1-9007afe2c4fa {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:21 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265.bdd1622f-adbb-4bf0-9ef1-9007afe2c4fa Nov 03 13:28:21 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:21 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-92a0e7bd-a6d0-4f54-9969-d83cc7c391b8 tempest-CreateVolumesFromSnapshotTest-846457304 None] Acquiring lock "cinder-66a63cd9-ddd2-4820-aa72-dd6c51a03745-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:22 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-92a0e7bd-a6d0-4f54-9969-d83cc7c391b8 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "cinder-66a63cd9-ddd2-4820-aa72-dd6c51a03745-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:22 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-92a0e7bd-a6d0-4f54-9969-d83cc7c391b8 tempest-CreateVolumesFromSnapshotTest-846457304 None] Acquiring lock "cinder-quobyte-66a63cd9-ddd2-4820-aa72-dd6c51a03745" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:22 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-92a0e7bd-a6d0-4f54-9969-d83cc7c391b8 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "cinder-quobyte-66a63cd9-ddd2-4820-aa72-dd6c51a03745" acquired by "delete_volume" :: waited 0.015s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:22 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76d016f-612b-4389-b072-127edeb3afa6]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-92a0e7bd-a6d0-4f54-9969-d83cc7c391b8 tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66a63cd9-ddd2-4820-aa72-dd6c51a03745 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:22 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66a63cd9-ddd2-4820-aa72-dd6c51a03745 Nov 03 13:28:22 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:22 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-194fec39-bfae-4466-adfa-7187fa55b98c tempest-CinderUnicodeTest-1843347469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265.bdd1622f-adbb-4bf0-9ef1-9007afe2c4fa" returned: 0 in 0.308s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-194fec39-bfae-4466-adfa-7187fa55b98c tempest-CinderUnicodeTest-1843347469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:22 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265.info Nov 03 13:28:22 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:22 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-92a0e7bd-a6d0-4f54-9969-d83cc7c391b8 tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66a63cd9-ddd2-4820-aa72-dd6c51a03745" returned: 0 in 0.409s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-92a0e7bd-a6d0-4f54-9969-d83cc7c391b8 tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66a63cd9-ddd2-4820-aa72-dd6c51a03745 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:22 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66a63cd9-ddd2-4820-aa72-dd6c51a03745 Nov 03 13:28:22 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:22 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-194fec39-bfae-4466-adfa-7187fa55b98c tempest-CinderUnicodeTest-1843347469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265.info" returned: 0 in 0.294s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:22 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-194fec39-bfae-4466-adfa-7187fa55b98c tempest-CinderUnicodeTest-1843347469 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265.info is being set with open permissions: ugo+rw Nov 03 13:28:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-194fec39-bfae-4466-adfa-7187fa55b98c tempest-CinderUnicodeTest-1843347469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:22 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265.info Nov 03 13:28:22 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:22 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-92a0e7bd-a6d0-4f54-9969-d83cc7c391b8 tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-66a63cd9-ddd2-4820-aa72-dd6c51a03745" returned: 0 in 0.281s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:22 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-92a0e7bd-a6d0-4f54-9969-d83cc7c391b8 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "cinder-quobyte-66a63cd9-ddd2-4820-aa72-dd6c51a03745" released by "delete_volume" :: held 0.745s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:22 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-194fec39-bfae-4466-adfa-7187fa55b98c tempest-CinderUnicodeTest-1843347469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265.info" returned: 0 in 0.260s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-194fec39-bfae-4466-adfa-7187fa55b98c tempest-CinderUnicodeTest-1843347469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.354s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-efa6bb0c-0ed4-4eb2-b2bf-d3c513b9c54b tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.811s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:22 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-efa6bb0c-0ed4-4eb2-b2bf-d3c513b9c54b tempest-ProjectMemberTests-1676407320 None] Creating offline snapshot bdb4e2d7-5f6f-43cc-838f-efa5d8846703 of volume 27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:28:22 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2b3bcd-001f-4883-bdbb-9988876c0ebb]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-efa6bb0c-0ed4-4eb2-b2bf-d3c513b9c54b tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:22 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-194fec39-bfae-4466-adfa-7187fa55b98c tempest-CinderUnicodeTest-1843347469 None] Create snapshot completed successfully Nov 03 13:28:22 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-92a0e7bd-a6d0-4f54-9969-d83cc7c391b8 tempest-CreateVolumesFromSnapshotTest-846457304 None] Created reservations ['f749d71e-9adb-4986-8b77-ca8c91474d1c', 'dff285cb-676f-409f-ab43-4d11f0f13ca4', 'c3c4ffaa-cbbf-49cf-abcc-2afaaa469a14', 'c63bbfbb-70dc-4327-ad0e-29eac18ddd5b'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-92a0e7bd-a6d0-4f54-9969-d83cc7c391b8 tempest-CreateVolumesFromSnapshotTest-846457304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-92a0e7bd-a6d0-4f54-9969-d83cc7c391b8 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:23 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-92a0e7bd-a6d0-4f54-9969-d83cc7c391b8 tempest-CreateVolumesFromSnapshotTest-846457304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:23 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-92a0e7bd-a6d0-4f54-9969-d83cc7c391b8 tempest-CreateVolumesFromSnapshotTest-846457304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-92a0e7bd-a6d0-4f54-9969-d83cc7c391b8 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-92a0e7bd-a6d0-4f54-9969-d83cc7c391b8 tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:23 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310 Nov 03 13:28:23 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:23 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:28:23 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:23 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-31499472-dd14-47b9-9a3d-1ed5b82ac976 tempest-CreateVolumesFromSnapshotTest-846457304 None] Acquiring lock "cinder-cae1fc20-d846-4440-afc0-84e18ace7571-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:23 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-31499472-dd14-47b9-9a3d-1ed5b82ac976 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "cinder-cae1fc20-d846-4440-afc0-84e18ace7571-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:23 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:23 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-31499472-dd14-47b9-9a3d-1ed5b82ac976 tempest-CreateVolumesFromSnapshotTest-846457304 None] Acquiring lock "cinder-quobyte-cae1fc20-d846-4440-afc0-84e18ace7571" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-92a0e7bd-a6d0-4f54-9969-d83cc7c391b8 tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.326s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:23 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-92a0e7bd-a6d0-4f54-9969-d83cc7c391b8 tempest-CreateVolumesFromSnapshotTest-846457304 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:28:23 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-92a0e7bd-a6d0-4f54-9969-d83cc7c391b8 tempest-CreateVolumesFromSnapshotTest-846457304 None] Deleted volume successfully. Nov 03 13:28:23 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-31499472-dd14-47b9-9a3d-1ed5b82ac976 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "cinder-quobyte-cae1fc20-d846-4440-afc0-84e18ace7571" acquired by "delete_volume" :: waited 0.033s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:23 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-efa6bb0c-0ed4-4eb2-b2bf-d3c513b9c54b tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310" returned: 0 in 0.491s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-efa6bb0c-0ed4-4eb2-b2bf-d3c513b9c54b tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310.bdb4e2d7-5f6f-43cc-838f-efa5d8846703 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:23 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c422611-7bbc-4ec9-b670-7a0276f5269b]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-31499472-dd14-47b9-9a3d-1ed5b82ac976 tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cae1fc20-d846-4440-afc0-84e18ace7571 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:23 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310.bdb4e2d7-5f6f-43cc-838f-efa5d8846703 1G Nov 03 13:28:23 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:23 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-92a0e7bd-a6d0-4f54-9969-d83cc7c391b8 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "cinder-66a63cd9-ddd2-4820-aa72-dd6c51a03745-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:23 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cae1fc20-d846-4440-afc0-84e18ace7571 Nov 03 13:28:23 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:23 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1ddcae9a-3bdc-43eb-a495-6e742c773c69 tempest-CinderUnicodeTest-1843347469 None] Acquiring lock "cinder-bdd1622f-adbb-4bf0-9ef1-9007afe2c4fa-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:23 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1ddcae9a-3bdc-43eb-a495-6e742c773c69 tempest-CinderUnicodeTest-1843347469 None] Lock "cinder-bdd1622f-adbb-4bf0-9ef1-9007afe2c4fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:23 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1ddcae9a-3bdc-43eb-a495-6e742c773c69 tempest-CinderUnicodeTest-1843347469 None] Acquiring lock "cinder-quobyte-1781a6b3-95dc-4426-8201-7749cc1d1265" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:23 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1ddcae9a-3bdc-43eb-a495-6e742c773c69 tempest-CinderUnicodeTest-1843347469 None] Lock "cinder-quobyte-1781a6b3-95dc-4426-8201-7749cc1d1265" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:23 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1ddcae9a-3bdc-43eb-a495-6e742c773c69 tempest-CinderUnicodeTest-1843347469 None] Acquiring lock "cinder-quobyte-bdd1622f-adbb-4bf0-9ef1-9007afe2c4fa" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:23 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1ddcae9a-3bdc-43eb-a495-6e742c773c69 tempest-CinderUnicodeTest-1843347469 None] Lock "cinder-quobyte-bdd1622f-adbb-4bf0-9ef1-9007afe2c4fa" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:23 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-1ddcae9a-3bdc-43eb-a495-6e742c773c69 tempest-CinderUnicodeTest-1843347469 None] Deleting offline snapshot bdd1622f-adbb-4bf0-9ef1-9007afe2c4fa of volume 1781a6b3-95dc-4426-8201-7749cc1d1265 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:28:23 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-1ddcae9a-3bdc-43eb-a495-6e742c773c69 tempest-CinderUnicodeTest-1843347469 None] snapshot_file for this snap is: volume-1781a6b3-95dc-4426-8201-7749cc1d1265.bdd1622f-adbb-4bf0-9ef1-9007afe2c4fa {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:28:23 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf98f40-47c1-481e-920e-f1a1f1720a71]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1ddcae9a-3bdc-43eb-a495-6e742c773c69 tempest-CinderUnicodeTest-1843347469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265.bdd1622f-adbb-4bf0-9ef1-9007afe2c4fa {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:23 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-31499472-dd14-47b9-9a3d-1ed5b82ac976 tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cae1fc20-d846-4440-afc0-84e18ace7571" returned: 0 in 0.512s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-31499472-dd14-47b9-9a3d-1ed5b82ac976 tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cae1fc20-d846-4440-afc0-84e18ace7571 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:23 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265.bdd1622f-adbb-4bf0-9ef1-9007afe2c4fa Nov 03 13:28:23 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:23 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:23 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cae1fc20-d846-4440-afc0-84e18ace7571 Nov 03 13:28:23 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:23 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] Flow 'volume_create_manager' (8d1f86d0-a58d-411d-aac9-7b48d39f1163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17a0a822-fd10-4feb-81f7-13755837ee9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-efa6bb0c-0ed4-4eb2-b2bf-d3c513b9c54b tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310.bdb4e2d7-5f6f-43cc-838f-efa5d8846703 1G" returned: 0 in 0.600s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-efa6bb0c-0ed4-4eb2-b2bf-d3c513b9c54b tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310.bdb4e2d7-5f6f-43cc-838f-efa5d8846703 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17a0a822-fd10-4feb-81f7-13755837ee9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1192468830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71b3594e-d167-4c51-954f-30ab93466ee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d44080166948cea704fa07a936c807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:24Z,use_quota=True,user_id='eaeace3300d748f19b758c594a4c4ee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:24 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310.bdb4e2d7-5f6f-43cc-838f-efa5d8846703 Nov 03 13:28:24 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0123458-5f6e-44e4-817a-c1f25d9b7feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0123458-5f6e-44e4-817a-c1f25d9b7feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (205a5b9d-8656-47b5-b903-fd3ff6de297d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (205a5b9d-8656-47b5-b903-fd3ff6de297d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71b3594e-d167-4c51-954f-30ab93466ee3', 'volume_name': 'volume-71b3594e-d167-4c51-954f-30ab93466ee3', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be6dd468-53f3-44ab-91b4-8ec2432877dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be6dd468-53f3-44ab-91b4-8ec2432877dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f484b3c7-b028-4133-ab2c-89fea89fcb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:24 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] Volume 71b3594e-d167-4c51-954f-30ab93466ee3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71b3594e-d167-4c51-954f-30ab93466ee3', 'volume_size': 1} Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:24 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-31499472-dd14-47b9-9a3d-1ed5b82ac976 tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-cae1fc20-d846-4440-afc0-84e18ace7571" returned: 0 in 0.279s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:24 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1ddcae9a-3bdc-43eb-a495-6e742c773c69 tempest-CinderUnicodeTest-1843347469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265.bdd1622f-adbb-4bf0-9ef1-9007afe2c4fa" returned: 0 in 0.409s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-1ddcae9a-3bdc-43eb-a495-6e742c773c69 tempest-CinderUnicodeTest-1843347469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1781a6b3-95dc-4426-8201-7749cc1d1265(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-31499472-dd14-47b9-9a3d-1ed5b82ac976 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "cinder-quobyte-cae1fc20-d846-4440-afc0-84e18ace7571" released by "delete_volume" :: held 0.866s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[a910710c-29df-4641-a823-5f2c93601a83]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1ddcae9a-3bdc-43eb-a495-6e742c773c69 tempest-CinderUnicodeTest-1843347469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-31499472-dd14-47b9-9a3d-1ed5b82ac976 tempest-CreateVolumesFromSnapshotTest-846457304 None] Created reservations ['5d1156c3-fc1d-49ac-8101-154c62ddeda6', '38880105-d0ab-4c03-915c-3f8dc8babe5b', '7e7cd8a9-b5f7-41f4-8f40-87ccd0c4a971', '6b0a17fd-54b4-4239-a815-50f8172ee932'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:24 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-efa6bb0c-0ed4-4eb2-b2bf-d3c513b9c54b tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310.bdb4e2d7-5f6f-43cc-838f-efa5d8846703" returned: 0 in 0.354s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:24 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-efa6bb0c-0ed4-4eb2-b2bf-d3c513b9c54b tempest-ProjectMemberTests-1676407320 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310.bdb4e2d7-5f6f-43cc-838f-efa5d8846703 is being set with open permissions: ugo+rw Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-efa6bb0c-0ed4-4eb2-b2bf-d3c513b9c54b tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310.bdb4e2d7-5f6f-43cc-838f-efa5d8846703 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:24 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310.bdb4e2d7-5f6f-43cc-838f-efa5d8846703 Nov 03 13:28:24 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-31499472-dd14-47b9-9a3d-1ed5b82ac976 tempest-CreateVolumesFromSnapshotTest-846457304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:24 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265 Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-31499472-dd14-47b9-9a3d-1ed5b82ac976 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-31499472-dd14-47b9-9a3d-1ed5b82ac976 tempest-CreateVolumesFromSnapshotTest-846457304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:24 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-31499472-dd14-47b9-9a3d-1ed5b82ac976 tempest-CreateVolumesFromSnapshotTest-846457304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-31499472-dd14-47b9-9a3d-1ed5b82ac976 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-31499472-dd14-47b9-9a3d-1ed5b82ac976 tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:24 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:28:24 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-382cae87-2aca-4cda-a6a9-e041660f8384 tempest-CreateVolumesFromSnapshotTest-846457304 None] Acquiring lock "cinder-7c0fd963-e7eb-4af5-94b1-5f54f3a6713e-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-382cae87-2aca-4cda-a6a9-e041660f8384 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "cinder-7c0fd963-e7eb-4af5-94b1-5f54f3a6713e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-382cae87-2aca-4cda-a6a9-e041660f8384 tempest-CreateVolumesFromSnapshotTest-846457304 None] Acquiring lock "cinder-quobyte-7c0fd963-e7eb-4af5-94b1-5f54f3a6713e" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-382cae87-2aca-4cda-a6a9-e041660f8384 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "cinder-quobyte-7c0fd963-e7eb-4af5-94b1-5f54f3a6713e" acquired by "delete_volume" :: waited 0.021s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d295a0-0957-4ea6-ab2f-b50251f12b6a]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-382cae87-2aca-4cda-a6a9-e041660f8384 tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7c0fd963-e7eb-4af5-94b1-5f54f3a6713e {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:24 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-efa6bb0c-0ed4-4eb2-b2bf-d3c513b9c54b tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310.bdb4e2d7-5f6f-43cc-838f-efa5d8846703" returned: 0 in 0.315s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-efa6bb0c-0ed4-4eb2-b2bf-d3c513b9c54b tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:24 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1ddcae9a-3bdc-43eb-a495-6e742c773c69 tempest-CinderUnicodeTest-1843347469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265" returned: 0 in 0.484s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:24 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7c0fd963-e7eb-4af5-94b1-5f54f3a6713e Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1ddcae9a-3bdc-43eb-a495-6e742c773c69 tempest-CinderUnicodeTest-1843347469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265.bdd1622f-adbb-4bf0-9ef1-9007afe2c4fa {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:24 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:24 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310.info Nov 03 13:28:24 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:24 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-31499472-dd14-47b9-9a3d-1ed5b82ac976 tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.355s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-31499472-dd14-47b9-9a3d-1ed5b82ac976 tempest-CreateVolumesFromSnapshotTest-846457304 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:28:24 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265.bdd1622f-adbb-4bf0-9ef1-9007afe2c4fa Nov 03 13:28:24 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:24 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-31499472-dd14-47b9-9a3d-1ed5b82ac976 tempest-CreateVolumesFromSnapshotTest-846457304 None] Deleted volume successfully. Nov 03 13:28:24 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-31499472-dd14-47b9-9a3d-1ed5b82ac976 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "cinder-cae1fc20-d846-4440-afc0-84e18ace7571-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:25 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-efa6bb0c-0ed4-4eb2-b2bf-d3c513b9c54b tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310.info" returned: 0 in 0.307s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:25 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-efa6bb0c-0ed4-4eb2-b2bf-d3c513b9c54b tempest-ProjectMemberTests-1676407320 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310.info is being set with open permissions: ugo+rw Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-efa6bb0c-0ed4-4eb2-b2bf-d3c513b9c54b tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:25 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-382cae87-2aca-4cda-a6a9-e041660f8384 tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7c0fd963-e7eb-4af5-94b1-5f54f3a6713e" returned: 0 in 0.426s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-382cae87-2aca-4cda-a6a9-e041660f8384 tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7c0fd963-e7eb-4af5-94b1-5f54f3a6713e {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:25 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310.info Nov 03 13:28:25 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:25 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7c0fd963-e7eb-4af5-94b1-5f54f3a6713e Nov 03 13:28:25 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:25 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1ddcae9a-3bdc-43eb-a495-6e742c773c69 tempest-CinderUnicodeTest-1843347469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265.bdd1622f-adbb-4bf0-9ef1-9007afe2c4fa" returned: 0 in 0.418s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1ddcae9a-3bdc-43eb-a495-6e742c773c69 tempest-CinderUnicodeTest-1843347469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265.bdd1622f-adbb-4bf0-9ef1-9007afe2c4fa {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:25 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265.bdd1622f-adbb-4bf0-9ef1-9007afe2c4fa Nov 03 13:28:25 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:25 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-efa6bb0c-0ed4-4eb2-b2bf-d3c513b9c54b tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310.info" returned: 0 in 0.284s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-efa6bb0c-0ed4-4eb2-b2bf-d3c513b9c54b tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.475s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.270s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1192468830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71b3594e-d167-4c51-954f-30ab93466ee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d44080166948cea704fa07a936c807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:24Z,use_quota=True,user_id='eaeace3300d748f19b758c594a4c4ee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] Creating volume 71b3594e-d167-4c51-954f-30ab93466ee3 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:25 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:28:25 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-382cae87-2aca-4cda-a6a9-e041660f8384 tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7c0fd963-e7eb-4af5-94b1-5f54f3a6713e" returned: 0 in 0.342s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:25 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3 1073741824 Nov 03 13:28:25 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-382cae87-2aca-4cda-a6a9-e041660f8384 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "cinder-quobyte-7c0fd963-e7eb-4af5-94b1-5f54f3a6713e" released by "delete_volume" :: held 0.833s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:25 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-efa6bb0c-0ed4-4eb2-b2bf-d3c513b9c54b tempest-ProjectMemberTests-1676407320 None] Create snapshot completed successfully Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-382cae87-2aca-4cda-a6a9-e041660f8384 tempest-CreateVolumesFromSnapshotTest-846457304 None] Created reservations ['6a5eda49-f4f0-4ede-9d9b-a5a2d925cb2f', 'bf14b3b5-dfd3-4b57-8781-bd9587300161', '15788f1b-5868-44b0-ae15-4b568527c24a', '712c5a5c-39e2-45f3-83fd-be273d40f89d'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:25 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-1ddcae9a-3bdc-43eb-a495-6e742c773c69 tempest-CinderUnicodeTest-1843347469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265.bdd1622f-adbb-4bf0-9ef1-9007afe2c4fa" returned: 0 in 0.301s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1ddcae9a-3bdc-43eb-a495-6e742c773c69 tempest-CinderUnicodeTest-1843347469 None] Lock "cinder-quobyte-bdd1622f-adbb-4bf0-9ef1-9007afe2c4fa" released by "_delete_snapshot" :: held 1.750s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1ddcae9a-3bdc-43eb-a495-6e742c773c69 tempest-CinderUnicodeTest-1843347469 None] Lock "cinder-quobyte-1781a6b3-95dc-4426-8201-7749cc1d1265" released by "delete_snapshot" :: held 1.786s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-382cae87-2aca-4cda-a6a9-e041660f8384 tempest-CreateVolumesFromSnapshotTest-846457304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-382cae87-2aca-4cda-a6a9-e041660f8384 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-382cae87-2aca-4cda-a6a9-e041660f8384 tempest-CreateVolumesFromSnapshotTest-846457304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-382cae87-2aca-4cda-a6a9-e041660f8384 tempest-CreateVolumesFromSnapshotTest-846457304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-382cae87-2aca-4cda-a6a9-e041660f8384 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-382cae87-2aca-4cda-a6a9-e041660f8384 tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:25 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:28:25 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-1ddcae9a-3bdc-43eb-a495-6e742c773c69 tempest-CinderUnicodeTest-1843347469 None] Created reservations ['08f12755-f8e6-4bb6-97a9-ece716d8aa6b', '34a82752-94d8-4daa-bb6e-ff59ce79db5c', '429af1fa-ff5a-43b8-a21a-59b5d080b734', '38c189e9-7130-45bc-a98d-1942df7a9848'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:25 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-1ddcae9a-3bdc-43eb-a495-6e742c773c69 tempest-CinderUnicodeTest-1843347469 None] Delete snapshot completed successfully. Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-1ddcae9a-3bdc-43eb-a495-6e742c773c69 tempest-CinderUnicodeTest-1843347469 None] Lock "cinder-bdd1622f-adbb-4bf0-9ef1-9007afe2c4fa-delete_snapshot" released by "delete_snapshot" :: held 1.976s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-38e04c6e-e629-4979-b59e-30ac6b659cba tempest-CreateVolumesFromSnapshotTest-846457304 None] Acquiring lock "cinder-fb0d02ca-259c-4c84-9ed1-7c053583682b-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-38e04c6e-e629-4979-b59e-30ac6b659cba tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "cinder-fb0d02ca-259c-4c84-9ed1-7c053583682b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-38e04c6e-e629-4979-b59e-30ac6b659cba tempest-CreateVolumesFromSnapshotTest-846457304 None] Acquiring lock "cinder-quobyte-6d66b2ed-5636-4905-ba38-61575c04ad15" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-38e04c6e-e629-4979-b59e-30ac6b659cba tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "cinder-quobyte-6d66b2ed-5636-4905-ba38-61575c04ad15" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-38e04c6e-e629-4979-b59e-30ac6b659cba tempest-CreateVolumesFromSnapshotTest-846457304 None] Acquiring lock "cinder-quobyte-fb0d02ca-259c-4c84-9ed1-7c053583682b" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-38e04c6e-e629-4979-b59e-30ac6b659cba tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "cinder-quobyte-fb0d02ca-259c-4c84-9ed1-7c053583682b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-38e04c6e-e629-4979-b59e-30ac6b659cba tempest-CreateVolumesFromSnapshotTest-846457304 None] Deleting offline snapshot fb0d02ca-259c-4c84-9ed1-7c053583682b of volume 6d66b2ed-5636-4905-ba38-61575c04ad15 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-38e04c6e-e629-4979-b59e-30ac6b659cba tempest-CreateVolumesFromSnapshotTest-846457304 None] snapshot_file for this snap is: volume-6d66b2ed-5636-4905-ba38-61575c04ad15.fb0d02ca-259c-4c84-9ed1-7c053583682b {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b5a77b-9e27-4690-9738-728f2beea941]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-38e04c6e-e629-4979-b59e-30ac6b659cba tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15.fb0d02ca-259c-4c84-9ed1-7c053583682b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:25 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-382cae87-2aca-4cda-a6a9-e041660f8384 tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.290s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-382cae87-2aca-4cda-a6a9-e041660f8384 tempest-CreateVolumesFromSnapshotTest-846457304 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:28:25 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-382cae87-2aca-4cda-a6a9-e041660f8384 tempest-CreateVolumesFromSnapshotTest-846457304 None] Deleted volume successfully. Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e84e8f59-70be-462a-8e7e-c26e6ae81257 tempest-CinderUnicodeTest-1843347469 None] Acquiring lock "cinder-1781a6b3-95dc-4426-8201-7749cc1d1265-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:25 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:25 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15.fb0d02ca-259c-4c84-9ed1-7c053583682b Nov 03 13:28:25 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-382cae87-2aca-4cda-a6a9-e041660f8384 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "cinder-7c0fd963-e7eb-4af5-94b1-5f54f3a6713e-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3 1073741824" returned: 0 in 0.614s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e84e8f59-70be-462a-8e7e-c26e6ae81257 tempest-CinderUnicodeTest-1843347469 None] Lock "cinder-1781a6b3-95dc-4426-8201-7749cc1d1265-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e84e8f59-70be-462a-8e7e-c26e6ae81257 tempest-CinderUnicodeTest-1843347469 None] Acquiring lock "cinder-quobyte-1781a6b3-95dc-4426-8201-7749cc1d1265" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:26 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3 Nov 03 13:28:26 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e84e8f59-70be-462a-8e7e-c26e6ae81257 tempest-CinderUnicodeTest-1843347469 None] Lock "cinder-quobyte-1781a6b3-95dc-4426-8201-7749cc1d1265" acquired by "delete_volume" :: waited 0.016s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[470dea0e-9202-4b10-8d86-9fc60e4c4ecf]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e84e8f59-70be-462a-8e7e-c26e6ae81257 tempest-CinderUnicodeTest-1843347469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:26 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265 Nov 03 13:28:26 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:26 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-38e04c6e-e629-4979-b59e-30ac6b659cba tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15.fb0d02ca-259c-4c84-9ed1-7c053583682b" returned: 0 in 0.419s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-38e04c6e-e629-4979-b59e-30ac6b659cba tempest-CreateVolumesFromSnapshotTest-846457304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d66b2ed-5636-4905-ba38-61575c04ad15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[21219bc7-8c90-4954-ba2d-e89f0907b571]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-38e04c6e-e629-4979-b59e-30ac6b659cba tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:26 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3" returned: 0 in 0.276s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-749d876f-2daa-40ca-8467-95a597c5bdc9 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-bdb4e2d7-5f6f-43cc-838f-efa5d8846703-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f484b3c7-b028-4133-ab2c-89fea89fcb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71b3594e-d167-4c51-954f-30ab93466ee3', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c14346fd-f6b8-4f95-9b1c-8179ecd9b35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-749d876f-2daa-40ca-8467-95a597c5bdc9 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-bdb4e2d7-5f6f-43cc-838f-efa5d8846703-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-749d876f-2daa-40ca-8467-95a597c5bdc9 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-quobyte-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:26 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] Volume volume-71b3594e-d167-4c51-954f-30ab93466ee3 (71b3594e-d167-4c51-954f-30ab93466ee3): created successfully Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c14346fd-f6b8-4f95-9b1c-8179ecd9b35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] Flow 'volume_create_manager' (8d1f86d0-a58d-411d-aac9-7b48d39f1163) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:26 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-f6e48e0c-d2ae-4d2e-b51d-e08f22e52a30 tempest-ProjectReaderTests-2033320378 None] Created volume successfully. Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-749d876f-2daa-40ca-8467-95a597c5bdc9 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-749d876f-2daa-40ca-8467-95a597c5bdc9 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-quobyte-bdb4e2d7-5f6f-43cc-838f-efa5d8846703" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-749d876f-2daa-40ca-8467-95a597c5bdc9 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-bdb4e2d7-5f6f-43cc-838f-efa5d8846703" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-749d876f-2daa-40ca-8467-95a597c5bdc9 tempest-ProjectMemberTests-1676407320 None] Deleting offline snapshot bdb4e2d7-5f6f-43cc-838f-efa5d8846703 of volume 27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:28:26 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15 Nov 03 13:28:26 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-749d876f-2daa-40ca-8467-95a597c5bdc9 tempest-ProjectMemberTests-1676407320 None] snapshot_file for this snap is: volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310.bdb4e2d7-5f6f-43cc-838f-efa5d8846703 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[be056066-8c33-4d81-90b2-944f344973e8]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-749d876f-2daa-40ca-8467-95a597c5bdc9 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310.bdb4e2d7-5f6f-43cc-838f-efa5d8846703 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:26 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e84e8f59-70be-462a-8e7e-c26e6ae81257 tempest-CinderUnicodeTest-1843347469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265" returned: 0 in 0.464s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e84e8f59-70be-462a-8e7e-c26e6ae81257 tempest-CinderUnicodeTest-1843347469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:26 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310.bdb4e2d7-5f6f-43cc-838f-efa5d8846703 Nov 03 13:28:26 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:26 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265 Nov 03 13:28:26 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:26 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-38e04c6e-e629-4979-b59e-30ac6b659cba tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15" returned: 0 in 0.434s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-38e04c6e-e629-4979-b59e-30ac6b659cba tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15.fb0d02ca-259c-4c84-9ed1-7c053583682b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:26 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15.fb0d02ca-259c-4c84-9ed1-7c053583682b Nov 03 13:28:26 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:26 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e84e8f59-70be-462a-8e7e-c26e6ae81257 tempest-CinderUnicodeTest-1843347469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1781a6b3-95dc-4426-8201-7749cc1d1265" returned: 0 in 0.284s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:26 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-749d876f-2daa-40ca-8467-95a597c5bdc9 tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310.bdb4e2d7-5f6f-43cc-838f-efa5d8846703" returned: 0 in 0.398s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-749d876f-2daa-40ca-8467-95a597c5bdc9 tempest-ProjectMemberTests-1676407320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e84e8f59-70be-462a-8e7e-c26e6ae81257 tempest-CinderUnicodeTest-1843347469 None] Lock "cinder-quobyte-1781a6b3-95dc-4426-8201-7749cc1d1265" released by "delete_volume" :: held 0.819s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[704059a2-67ee-4fd4-ab85-7c2634fe1d27]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-749d876f-2daa-40ca-8467-95a597c5bdc9 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:26 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-e84e8f59-70be-462a-8e7e-c26e6ae81257 tempest-CinderUnicodeTest-1843347469 None] Created reservations ['989489c0-2e6f-49bd-bb20-6bf2b2d9447e', 'f49eddbb-6d59-469f-80f1-0131391e0a24', '17162ece-192d-4a28-af8f-3f2b228553e1', 'ed22ea2c-0ab7-43c6-b6ec-e86252b3bbc5'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:27 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310 Nov 03 13:28:27 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e84e8f59-70be-462a-8e7e-c26e6ae81257 tempest-CinderUnicodeTest-1843347469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e84e8f59-70be-462a-8e7e-c26e6ae81257 tempest-CinderUnicodeTest-1843347469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-e84e8f59-70be-462a-8e7e-c26e6ae81257 tempest-CinderUnicodeTest-1843347469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-e84e8f59-70be-462a-8e7e-c26e6ae81257 tempest-CinderUnicodeTest-1843347469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e84e8f59-70be-462a-8e7e-c26e6ae81257 tempest-CinderUnicodeTest-1843347469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e84e8f59-70be-462a-8e7e-c26e6ae81257 tempest-CinderUnicodeTest-1843347469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:27 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:28:27 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:27 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-38e04c6e-e629-4979-b59e-30ac6b659cba tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15.fb0d02ca-259c-4c84-9ed1-7c053583682b" returned: 0 in 0.416s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-38e04c6e-e629-4979-b59e-30ac6b659cba tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15.fb0d02ca-259c-4c84-9ed1-7c053583682b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d3f09efb-7c54-4dbf-a647-b18b72086810 tempest-CinderUnicodeTest-1843347469 None] Acquiring lock "cinder-0122d764-73c5-44a0-83be-63695dfbe942-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d3f09efb-7c54-4dbf-a647-b18b72086810 tempest-CinderUnicodeTest-1843347469 None] Lock "cinder-0122d764-73c5-44a0-83be-63695dfbe942-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:27 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15.fb0d02ca-259c-4c84-9ed1-7c053583682b Nov 03 13:28:27 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d3f09efb-7c54-4dbf-a647-b18b72086810 tempest-CinderUnicodeTest-1843347469 None] Acquiring lock "cinder-quobyte-0122d764-73c5-44a0-83be-63695dfbe942" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d3f09efb-7c54-4dbf-a647-b18b72086810 tempest-CinderUnicodeTest-1843347469 None] Lock "cinder-quobyte-0122d764-73c5-44a0-83be-63695dfbe942" acquired by "delete_volume" :: waited 0.033s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:27 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-749d876f-2daa-40ca-8467-95a597c5bdc9 tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310" returned: 0 in 0.461s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-749d876f-2daa-40ca-8467-95a597c5bdc9 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310.bdb4e2d7-5f6f-43cc-838f-efa5d8846703 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:27 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ec8311-2d7d-48e9-a51d-b1f048dac3a5]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d3f09efb-7c54-4dbf-a647-b18b72086810 tempest-CinderUnicodeTest-1843347469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0122d764-73c5-44a0-83be-63695dfbe942 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:27 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310.bdb4e2d7-5f6f-43cc-838f-efa5d8846703 Nov 03 13:28:27 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e84e8f59-70be-462a-8e7e-c26e6ae81257 tempest-CinderUnicodeTest-1843347469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.360s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-e84e8f59-70be-462a-8e7e-c26e6ae81257 tempest-CinderUnicodeTest-1843347469 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:28:27 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-e84e8f59-70be-462a-8e7e-c26e6ae81257 tempest-CinderUnicodeTest-1843347469 None] Deleted volume successfully. Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e84e8f59-70be-462a-8e7e-c26e6ae81257 tempest-CinderUnicodeTest-1843347469 None] Lock "cinder-1781a6b3-95dc-4426-8201-7749cc1d1265-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c7fde558-808a-4d7e-a99c-bebf1404ad4a tempest-ProjectReaderTests-2033320378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c7fde558-808a-4d7e-a99c-bebf1404ad4a tempest-ProjectReaderTests-2033320378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-c7fde558-808a-4d7e-a99c-bebf1404ad4a tempest-ProjectReaderTests-2033320378 None] Creating offline snapshot 01c4403b-cbd0-4da6-bb1f-b53d2bdc9309 of volume 71b3594e-d167-4c51-954f-30ab93466ee3 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:28:27 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0122d764-73c5-44a0-83be-63695dfbe942 Nov 03 13:28:27 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:27 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-38e04c6e-e629-4979-b59e-30ac6b659cba tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15.fb0d02ca-259c-4c84-9ed1-7c053583682b" returned: 0 in 0.424s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff845db1-d381-4405-ad08-bdf047c39fe7]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c7fde558-808a-4d7e-a99c-bebf1404ad4a tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-38e04c6e-e629-4979-b59e-30ac6b659cba tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "cinder-quobyte-fb0d02ca-259c-4c84-9ed1-7c053583682b" released by "_delete_snapshot" :: held 1.830s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-38e04c6e-e629-4979-b59e-30ac6b659cba tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "cinder-quobyte-6d66b2ed-5636-4905-ba38-61575c04ad15" released by "delete_snapshot" :: held 1.858s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-38e04c6e-e629-4979-b59e-30ac6b659cba tempest-CreateVolumesFromSnapshotTest-846457304 None] Created reservations ['ff0d7373-c869-4839-b498-84b8a971c2c5', '4ff6e3de-2c21-4203-8dbe-839343329bd0', '120fdc60-0b1e-4caa-b099-52a250c506d2', '24c1edd9-0348-4a69-b3d2-9b1cad5441a1'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:27 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3 Nov 03 13:28:27 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:27 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-38e04c6e-e629-4979-b59e-30ac6b659cba tempest-CreateVolumesFromSnapshotTest-846457304 None] Delete snapshot completed successfully. Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-38e04c6e-e629-4979-b59e-30ac6b659cba tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "cinder-fb0d02ca-259c-4c84-9ed1-7c053583682b-delete_snapshot" released by "delete_snapshot" :: held 2.023s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:27 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-749d876f-2daa-40ca-8467-95a597c5bdc9 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310.bdb4e2d7-5f6f-43cc-838f-efa5d8846703" returned: 0 in 0.474s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-749d876f-2daa-40ca-8467-95a597c5bdc9 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310.bdb4e2d7-5f6f-43cc-838f-efa5d8846703 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:27 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310.bdb4e2d7-5f6f-43cc-838f-efa5d8846703 Nov 03 13:28:27 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d3f09efb-7c54-4dbf-a647-b18b72086810 tempest-CinderUnicodeTest-1843347469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0122d764-73c5-44a0-83be-63695dfbe942" returned: 0 in 0.487s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:27 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d3f09efb-7c54-4dbf-a647-b18b72086810 tempest-CinderUnicodeTest-1843347469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0122d764-73c5-44a0-83be-63695dfbe942 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:27 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0122d764-73c5-44a0-83be-63695dfbe942 Nov 03 13:28:27 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d3beae41-1662-4a25-9cc9-6a4f5bf06e22 tempest-CreateVolumesFromSnapshotTest-846457304 None] Acquiring lock "cinder-6d66b2ed-5636-4905-ba38-61575c04ad15-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:27 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d3beae41-1662-4a25-9cc9-6a4f5bf06e22 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "cinder-6d66b2ed-5636-4905-ba38-61575c04ad15-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d3beae41-1662-4a25-9cc9-6a4f5bf06e22 tempest-CreateVolumesFromSnapshotTest-846457304 None] Acquiring lock "cinder-quobyte-6d66b2ed-5636-4905-ba38-61575c04ad15" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d3beae41-1662-4a25-9cc9-6a4f5bf06e22 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "cinder-quobyte-6d66b2ed-5636-4905-ba38-61575c04ad15" acquired by "delete_volume" :: waited 0.025s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:28 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c7fde558-808a-4d7e-a99c-bebf1404ad4a tempest-ProjectReaderTests-2033320378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3" returned: 0 in 0.496s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c7fde558-808a-4d7e-a99c-bebf1404ad4a tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3.01c4403b-cbd0-4da6-bb1f-b53d2bdc9309 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[448f0d5e-0cc0-44f8-ae97-6cc49ff476ff]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d3beae41-1662-4a25-9cc9-6a4f5bf06e22 tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:28 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3.01c4403b-cbd0-4da6-bb1f-b53d2bdc9309 1G Nov 03 13:28:28 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:28 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-749d876f-2daa-40ca-8467-95a597c5bdc9 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310.bdb4e2d7-5f6f-43cc-838f-efa5d8846703" returned: 0 in 0.342s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:28 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d3f09efb-7c54-4dbf-a647-b18b72086810 tempest-CinderUnicodeTest-1843347469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-0122d764-73c5-44a0-83be-63695dfbe942" returned: 0 in 0.352s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-749d876f-2daa-40ca-8467-95a597c5bdc9 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-bdb4e2d7-5f6f-43cc-838f-efa5d8846703" released by "_delete_snapshot" :: held 1.821s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-749d876f-2daa-40ca-8467-95a597c5bdc9 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310" released by "delete_snapshot" :: held 1.850s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:28 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15 Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d3f09efb-7c54-4dbf-a647-b18b72086810 tempest-CinderUnicodeTest-1843347469 None] Lock "cinder-quobyte-0122d764-73c5-44a0-83be-63695dfbe942" released by "delete_volume" :: held 0.927s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:28 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-d3f09efb-7c54-4dbf-a647-b18b72086810 tempest-CinderUnicodeTest-1843347469 None] Created reservations ['5753fd31-ccfc-41d9-bc3e-90498e5d457d', 'd5800cde-aa1b-4118-b97b-c1449ba97430', 'b7e0d76b-0761-4534-8ee3-e34909a92b27', 'a1ec07d9-4789-477a-9963-f8dc30d6ab2e'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-749d876f-2daa-40ca-8467-95a597c5bdc9 tempest-ProjectMemberTests-1676407320 None] Created reservations ['ead15469-7075-444b-8597-5f53a17ab64b', '2517ce01-0047-4b41-92a0-7babd8a64e0c', '406af34c-a67a-42cb-8d66-6426e9c8400b', '4ccfb6d4-0362-4b3b-a324-7de3c429a6ad'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d3f09efb-7c54-4dbf-a647-b18b72086810 tempest-CinderUnicodeTest-1843347469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d3f09efb-7c54-4dbf-a647-b18b72086810 tempest-CinderUnicodeTest-1843347469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d3f09efb-7c54-4dbf-a647-b18b72086810 tempest-CinderUnicodeTest-1843347469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d3f09efb-7c54-4dbf-a647-b18b72086810 tempest-CinderUnicodeTest-1843347469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d3f09efb-7c54-4dbf-a647-b18b72086810 tempest-CinderUnicodeTest-1843347469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d3f09efb-7c54-4dbf-a647-b18b72086810 tempest-CinderUnicodeTest-1843347469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:28 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:28:28 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:28 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-749d876f-2daa-40ca-8467-95a597c5bdc9 tempest-ProjectMemberTests-1676407320 None] Delete snapshot completed successfully. Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-749d876f-2daa-40ca-8467-95a597c5bdc9 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-bdb4e2d7-5f6f-43cc-838f-efa5d8846703-delete_snapshot" released by "delete_snapshot" :: held 2.162s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-57f60d17-2ee9-4ac4-9360-db14c612d5e0 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-57f60d17-2ee9-4ac4-9360-db14c612d5e0 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:28 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d3beae41-1662-4a25-9cc9-6a4f5bf06e22 tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15" returned: 0 in 0.500s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d3beae41-1662-4a25-9cc9-6a4f5bf06e22 tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-57f60d17-2ee9-4ac4-9360-db14c612d5e0 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-quobyte-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:28 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15 Nov 03 13:28:28 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-57f60d17-2ee9-4ac4-9360-db14c612d5e0 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310" acquired by "delete_volume" :: waited 0.024s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:28 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c7fde558-808a-4d7e-a99c-bebf1404ad4a tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3.01c4403b-cbd0-4da6-bb1f-b53d2bdc9309 1G" returned: 0 in 0.598s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c7fde558-808a-4d7e-a99c-bebf1404ad4a tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71b3594e-d167-4c51-954f-30ab93466ee3 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3.01c4403b-cbd0-4da6-bb1f-b53d2bdc9309 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a32428-0222-4b1e-b8ea-ff3355145bf9]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-57f60d17-2ee9-4ac4-9360-db14c612d5e0 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:28 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71b3594e-d167-4c51-954f-30ab93466ee3 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3.01c4403b-cbd0-4da6-bb1f-b53d2bdc9309 Nov 03 13:28:28 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:28 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d3f09efb-7c54-4dbf-a647-b18b72086810 tempest-CinderUnicodeTest-1843347469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.325s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-d3f09efb-7c54-4dbf-a647-b18b72086810 tempest-CinderUnicodeTest-1843347469 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:28:28 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-d3f09efb-7c54-4dbf-a647-b18b72086810 tempest-CinderUnicodeTest-1843347469 None] Deleted volume successfully. Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d3f09efb-7c54-4dbf-a647-b18b72086810 tempest-CinderUnicodeTest-1843347469 None] Lock "cinder-0122d764-73c5-44a0-83be-63695dfbe942-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:28 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310 Nov 03 13:28:28 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:28 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d3beae41-1662-4a25-9cc9-6a4f5bf06e22 tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-6d66b2ed-5636-4905-ba38-61575c04ad15" returned: 0 in 0.292s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d3beae41-1662-4a25-9cc9-6a4f5bf06e22 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "cinder-quobyte-6d66b2ed-5636-4905-ba38-61575c04ad15" released by "delete_volume" :: held 0.882s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:28 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-d3beae41-1662-4a25-9cc9-6a4f5bf06e22 tempest-CreateVolumesFromSnapshotTest-846457304 None] Created reservations ['c7f5f390-8115-444c-acaf-bdf1e5195f8b', '99ea5035-9ce5-482b-a87b-885334280f8c', '2d404423-9a10-464d-a5c7-0472d7a1ac97', '2b815cfe-2529-4f3a-b597-94e1286575f0'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:29 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c7fde558-808a-4d7e-a99c-bebf1404ad4a tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71b3594e-d167-4c51-954f-30ab93466ee3 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3.01c4403b-cbd0-4da6-bb1f-b53d2bdc9309" returned: 0 in 0.335s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:29 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-c7fde558-808a-4d7e-a99c-bebf1404ad4a tempest-ProjectReaderTests-2033320378 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3.01c4403b-cbd0-4da6-bb1f-b53d2bdc9309 is being set with open permissions: ugo+rw Nov 03 13:28:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c7fde558-808a-4d7e-a99c-bebf1404ad4a tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3.01c4403b-cbd0-4da6-bb1f-b53d2bdc9309 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d3beae41-1662-4a25-9cc9-6a4f5bf06e22 tempest-CreateVolumesFromSnapshotTest-846457304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d3beae41-1662-4a25-9cc9-6a4f5bf06e22 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:29 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d3beae41-1662-4a25-9cc9-6a4f5bf06e22 tempest-CreateVolumesFromSnapshotTest-846457304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:29 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3.01c4403b-cbd0-4da6-bb1f-b53d2bdc9309 Nov 03 13:28:29 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:29 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d3beae41-1662-4a25-9cc9-6a4f5bf06e22 tempest-CreateVolumesFromSnapshotTest-846457304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d3beae41-1662-4a25-9cc9-6a4f5bf06e22 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d3beae41-1662-4a25-9cc9-6a4f5bf06e22 tempest-CreateVolumesFromSnapshotTest-846457304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:29 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:28:29 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:29 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-57f60d17-2ee9-4ac4-9360-db14c612d5e0 tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310" returned: 0 in 0.419s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-57f60d17-2ee9-4ac4-9360-db14c612d5e0 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:29 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310 Nov 03 13:28:29 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:29 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c7fde558-808a-4d7e-a99c-bebf1404ad4a tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3.01c4403b-cbd0-4da6-bb1f-b53d2bdc9309" returned: 0 in 0.296s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:29 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c7fde558-808a-4d7e-a99c-bebf1404ad4a tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d3beae41-1662-4a25-9cc9-6a4f5bf06e22 tempest-CreateVolumesFromSnapshotTest-846457304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.295s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:29 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-d3beae41-1662-4a25-9cc9-6a4f5bf06e22 tempest-CreateVolumesFromSnapshotTest-846457304 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:28:29 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-d3beae41-1662-4a25-9cc9-6a4f5bf06e22 tempest-CreateVolumesFromSnapshotTest-846457304 None] Deleted volume successfully. Nov 03 13:28:29 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3.info Nov 03 13:28:29 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:29 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d3beae41-1662-4a25-9cc9-6a4f5bf06e22 tempest-CreateVolumesFromSnapshotTest-846457304 None] Lock "cinder-6d66b2ed-5636-4905-ba38-61575c04ad15-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:29 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-57f60d17-2ee9-4ac4-9360-db14c612d5e0 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310" returned: 0 in 0.344s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:29 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-57f60d17-2ee9-4ac4-9360-db14c612d5e0 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310" released by "delete_volume" :: held 0.849s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:29 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-57f60d17-2ee9-4ac4-9360-db14c612d5e0 tempest-ProjectMemberTests-1676407320 None] Created reservations ['0d468b34-5833-4354-8645-05f2a863bc01', '455b4257-506e-4c73-abf0-626147955e34', 'a5083a69-f4ba-4f77-a31d-1f7272211d9e', '36effeb3-d6b1-416e-aeec-696e221d1171'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-57f60d17-2ee9-4ac4-9360-db14c612d5e0 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-57f60d17-2ee9-4ac4-9360-db14c612d5e0 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:29 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-57f60d17-2ee9-4ac4-9360-db14c612d5e0 tempest-ProjectMemberTests-1676407320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:29 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-57f60d17-2ee9-4ac4-9360-db14c612d5e0 tempest-ProjectMemberTests-1676407320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-57f60d17-2ee9-4ac4-9360-db14c612d5e0 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-57f60d17-2ee9-4ac4-9360-db14c612d5e0 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:29 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:28:29 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:29 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c7fde558-808a-4d7e-a99c-bebf1404ad4a tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3.info" returned: 0 in 0.352s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:29 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-c7fde558-808a-4d7e-a99c-bebf1404ad4a tempest-ProjectReaderTests-2033320378 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3.info is being set with open permissions: ugo+rw Nov 03 13:28:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c7fde558-808a-4d7e-a99c-bebf1404ad4a tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:29 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3.info Nov 03 13:28:29 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:30 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-57f60d17-2ee9-4ac4-9360-db14c612d5e0 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.353s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:30 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-57f60d17-2ee9-4ac4-9360-db14c612d5e0 tempest-ProjectMemberTests-1676407320 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:28:30 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-57f60d17-2ee9-4ac4-9360-db14c612d5e0 tempest-ProjectMemberTests-1676407320 None] Deleted volume successfully. Nov 03 13:28:30 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-57f60d17-2ee9-4ac4-9360-db14c612d5e0 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-27fc1ce2-afcf-43bb-bfb2-c1b1fbcb8310-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:30 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c7fde558-808a-4d7e-a99c-bebf1404ad4a tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3.info" returned: 0 in 0.398s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c7fde558-808a-4d7e-a99c-bebf1404ad4a tempest-ProjectReaderTests-2033320378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.608s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:30 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-c7fde558-808a-4d7e-a99c-bebf1404ad4a tempest-ProjectReaderTests-2033320378 None] Create snapshot completed successfully Nov 03 13:28:30 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:28:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] Flow 'volume_create_manager' (46020c14-c8c3-4522-9bde-30a884078cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db9da2e0-4a8c-4b6e-9181-97e82f1ed7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db9da2e0-4a8c-4b6e-9181-97e82f1ed7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-415947355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60ac3b296fa402ebc45563747540073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:30Z,use_quota=True,user_id='82e28082879940beb510c24ff3452f75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda28058-0b51-4736-8146-8d5c53998840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda28058-0b51-4736-8146-8d5c53998840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13bcb4bf-4b33-4559-8289-a3d470a953fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13bcb4bf-4b33-4559-8289-a3d470a953fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0', 'volume_name': 'volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5136c8a1-3df6-4dc2-9c78-7ac758f1d7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5136c8a1-3df6-4dc2-9c78-7ac758f1d7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:30 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb12af86-ae79-44ae-9930-043658d7c670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:30 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] Volume db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0', 'volume_size': 1} Nov 03 13:28:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:30 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-415947355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60ac3b296fa402ebc45563747540073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:30Z,use_quota=True,user_id='82e28082879940beb510c24ff3452f75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:28:30 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] Creating volume db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:28:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:30 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:30 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:30 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:28:30 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:28:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:30 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0 1073741824 Nov 03 13:28:30 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:31 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0 1073741824" returned: 0 in 0.572s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:31 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-83d88a66-0b64-4039-84ff-d24797428c54 tempest-ProjectReaderTests-2033320378 None] Acquiring lock "cinder-01c4403b-cbd0-4da6-bb1f-b53d2bdc9309-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:31 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0 Nov 03 13:28:31 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:31 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-83d88a66-0b64-4039-84ff-d24797428c54 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-01c4403b-cbd0-4da6-bb1f-b53d2bdc9309-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:31 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-83d88a66-0b64-4039-84ff-d24797428c54 tempest-ProjectReaderTests-2033320378 None] Acquiring lock "cinder-quobyte-71b3594e-d167-4c51-954f-30ab93466ee3" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:31 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-83d88a66-0b64-4039-84ff-d24797428c54 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-quobyte-71b3594e-d167-4c51-954f-30ab93466ee3" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:31 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-83d88a66-0b64-4039-84ff-d24797428c54 tempest-ProjectReaderTests-2033320378 None] Acquiring lock "cinder-quobyte-01c4403b-cbd0-4da6-bb1f-b53d2bdc9309" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:31 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-83d88a66-0b64-4039-84ff-d24797428c54 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-quobyte-01c4403b-cbd0-4da6-bb1f-b53d2bdc9309" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:31 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-83d88a66-0b64-4039-84ff-d24797428c54 tempest-ProjectReaderTests-2033320378 None] Deleting offline snapshot 01c4403b-cbd0-4da6-bb1f-b53d2bdc9309 of volume 71b3594e-d167-4c51-954f-30ab93466ee3 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:28:31 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-83d88a66-0b64-4039-84ff-d24797428c54 tempest-ProjectReaderTests-2033320378 None] snapshot_file for this snap is: volume-71b3594e-d167-4c51-954f-30ab93466ee3.01c4403b-cbd0-4da6-bb1f-b53d2bdc9309 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:28:31 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[8deb983f-61d5-4778-8033-ac38a03bc729]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-83d88a66-0b64-4039-84ff-d24797428c54 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3.01c4403b-cbd0-4da6-bb1f-b53d2bdc9309 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:31 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0" returned: 0 in 0.387s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:31 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:28:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:31 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3.01c4403b-cbd0-4da6-bb1f-b53d2bdc9309 Nov 03 13:28:31 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb12af86-ae79-44ae-9930-043658d7c670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cef205d9-9bb5-4f0d-b525-d9fd76d599e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:31 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] Volume volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0 (db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0): created successfully Nov 03 13:28:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cef205d9-9bb5-4f0d-b525-d9fd76d599e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:31 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] Flow 'volume_create_manager' (46020c14-c8c3-4522-9bde-30a884078cc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:31 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-08552699-3281-4e05-bfe9-9715de4f140c tempest-ProjectMemberTests-1676407320 None] Created volume successfully. Nov 03 13:28:31 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-83d88a66-0b64-4039-84ff-d24797428c54 tempest-ProjectReaderTests-2033320378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3.01c4403b-cbd0-4da6-bb1f-b53d2bdc9309" returned: 0 in 0.438s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:31 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-83d88a66-0b64-4039-84ff-d24797428c54 tempest-ProjectReaderTests-2033320378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71b3594e-d167-4c51-954f-30ab93466ee3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:28:31 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3755c9-1a46-4d12-afa5-12fe40bd601f]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-83d88a66-0b64-4039-84ff-d24797428c54 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:32 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3 Nov 03 13:28:32 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:32 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-83d88a66-0b64-4039-84ff-d24797428c54 tempest-ProjectReaderTests-2033320378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3" returned: 0 in 0.419s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-83d88a66-0b64-4039-84ff-d24797428c54 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3.01c4403b-cbd0-4da6-bb1f-b53d2bdc9309 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:32 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3.01c4403b-cbd0-4da6-bb1f-b53d2bdc9309 Nov 03 13:28:32 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-10265b7a-69da-40c6-ab57-451e7208d71b tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-10265b7a-69da-40c6-ab57-451e7208d71b tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:32 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-10265b7a-69da-40c6-ab57-451e7208d71b tempest-ProjectMemberTests-1676407320 None] Creating offline snapshot 60ae39fc-8de4-46d1-9482-eb82b0ba72f4 of volume db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:28:32 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64f2f77-1afc-407f-a912-388d2cacb1a9]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-10265b7a-69da-40c6-ab57-451e7208d71b tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:32 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-83d88a66-0b64-4039-84ff-d24797428c54 tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3.01c4403b-cbd0-4da6-bb1f-b53d2bdc9309" returned: 0 in 0.482s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-83d88a66-0b64-4039-84ff-d24797428c54 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3.01c4403b-cbd0-4da6-bb1f-b53d2bdc9309 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:32 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3.01c4403b-cbd0-4da6-bb1f-b53d2bdc9309 Nov 03 13:28:32 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:32 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0 Nov 03 13:28:32 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:33 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-83d88a66-0b64-4039-84ff-d24797428c54 tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3.01c4403b-cbd0-4da6-bb1f-b53d2bdc9309" returned: 0 in 0.345s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:33 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-83d88a66-0b64-4039-84ff-d24797428c54 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-quobyte-01c4403b-cbd0-4da6-bb1f-b53d2bdc9309" released by "_delete_snapshot" :: held 1.863s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:33 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-83d88a66-0b64-4039-84ff-d24797428c54 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-quobyte-71b3594e-d167-4c51-954f-30ab93466ee3" released by "delete_snapshot" :: held 1.918s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:33 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:33 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=219,cinder:UPDATE=295,cinder:DELETE=26,cinder:INSERT=77 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:28:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-10265b7a-69da-40c6-ab57-451e7208d71b tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0" returned: 0 in 0.460s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-10265b7a-69da-40c6-ab57-451e7208d71b tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0.60ae39fc-8de4-46d1-9482-eb82b0ba72f4 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:33 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:UPDATE=286,cinder:SELECT=207,cinder:INSERT=71,cinder:DELETE=27 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:28:33 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0.60ae39fc-8de4-46d1-9482-eb82b0ba72f4 1G Nov 03 13:28:33 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:33 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-83d88a66-0b64-4039-84ff-d24797428c54 tempest-ProjectReaderTests-2033320378 None] Created reservations ['aaba5a8b-267a-4aaa-b192-aa6b7d592589', '6b8e86de-6a62-4eeb-8411-548b227cc1fa', 'f86fd4a5-ea9f-410c-9932-9b65b8359a89', 'ab8c1073-31be-4974-9d59-3922561a54ce'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:33 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-83d88a66-0b64-4039-84ff-d24797428c54 tempest-ProjectReaderTests-2033320378 None] Delete snapshot completed successfully. Nov 03 13:28:33 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-83d88a66-0b64-4039-84ff-d24797428c54 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-01c4403b-cbd0-4da6-bb1f-b53d2bdc9309-delete_snapshot" released by "delete_snapshot" :: held 2.202s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:33 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-10265b7a-69da-40c6-ab57-451e7208d71b tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0.60ae39fc-8de4-46d1-9482-eb82b0ba72f4 1G" returned: 0 in 0.545s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-10265b7a-69da-40c6-ab57-451e7208d71b tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0.60ae39fc-8de4-46d1-9482-eb82b0ba72f4 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:33 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0.60ae39fc-8de4-46d1-9482-eb82b0ba72f4 Nov 03 13:28:33 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:34 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-10265b7a-69da-40c6-ab57-451e7208d71b tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0.60ae39fc-8de4-46d1-9482-eb82b0ba72f4" returned: 0 in 0.331s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:34 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-10265b7a-69da-40c6-ab57-451e7208d71b tempest-ProjectMemberTests-1676407320 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0.60ae39fc-8de4-46d1-9482-eb82b0ba72f4 is being set with open permissions: ugo+rw Nov 03 13:28:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-10265b7a-69da-40c6-ab57-451e7208d71b tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0.60ae39fc-8de4-46d1-9482-eb82b0ba72f4 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:34 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0.60ae39fc-8de4-46d1-9482-eb82b0ba72f4 Nov 03 13:28:34 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:34 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-10265b7a-69da-40c6-ab57-451e7208d71b tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0.60ae39fc-8de4-46d1-9482-eb82b0ba72f4" returned: 0 in 0.293s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-10265b7a-69da-40c6-ab57-451e7208d71b tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:34 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-88cc72a3-3d5c-4d55-aea4-efe4e1f632bf tempest-ProjectReaderTests-2033320378 None] Acquiring lock "cinder-71b3594e-d167-4c51-954f-30ab93466ee3-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:34 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0.info Nov 03 13:28:34 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:34 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-88cc72a3-3d5c-4d55-aea4-efe4e1f632bf tempest-ProjectReaderTests-2033320378 None] Lock "cinder-71b3594e-d167-4c51-954f-30ab93466ee3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:34 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-88cc72a3-3d5c-4d55-aea4-efe4e1f632bf tempest-ProjectReaderTests-2033320378 None] Acquiring lock "cinder-quobyte-71b3594e-d167-4c51-954f-30ab93466ee3" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:34 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-88cc72a3-3d5c-4d55-aea4-efe4e1f632bf tempest-ProjectReaderTests-2033320378 None] Lock "cinder-quobyte-71b3594e-d167-4c51-954f-30ab93466ee3" acquired by "delete_volume" :: waited 0.017s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:34 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[e125283f-9e40-43b2-82ab-a15796b13513]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-88cc72a3-3d5c-4d55-aea4-efe4e1f632bf tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:34 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-10265b7a-69da-40c6-ab57-451e7208d71b tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0.info" returned: 0 in 0.330s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:34 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-10265b7a-69da-40c6-ab57-451e7208d71b tempest-ProjectMemberTests-1676407320 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0.info is being set with open permissions: ugo+rw Nov 03 13:28:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-10265b7a-69da-40c6-ab57-451e7208d71b tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:34 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3 Nov 03 13:28:34 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:34 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0.info Nov 03 13:28:34 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:35 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-10265b7a-69da-40c6-ab57-451e7208d71b tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0.info" returned: 0 in 0.308s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:35 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-10265b7a-69da-40c6-ab57-451e7208d71b tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.377s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-88cc72a3-3d5c-4d55-aea4-efe4e1f632bf tempest-ProjectReaderTests-2033320378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3" returned: 0 in 0.465s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-88cc72a3-3d5c-4d55-aea4-efe4e1f632bf tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:35 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3 Nov 03 13:28:35 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:35 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-10265b7a-69da-40c6-ab57-451e7208d71b tempest-ProjectMemberTests-1676407320 None] Create snapshot completed successfully Nov 03 13:28:35 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-88cc72a3-3d5c-4d55-aea4-efe4e1f632bf tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-71b3594e-d167-4c51-954f-30ab93466ee3" returned: 0 in 0.286s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-88cc72a3-3d5c-4d55-aea4-efe4e1f632bf tempest-ProjectReaderTests-2033320378 None] Lock "cinder-quobyte-71b3594e-d167-4c51-954f-30ab93466ee3" released by "delete_volume" :: held 0.834s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:35 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-88cc72a3-3d5c-4d55-aea4-efe4e1f632bf tempest-ProjectReaderTests-2033320378 None] Created reservations ['7d220447-d8f8-4616-a0b9-a53bc594ed7e', 'f0497756-0bc6-46ca-8187-89dd8d9325d7', '1bb11a13-6619-4688-a7d4-a60e088ffa78', 'c28771d9-16a9-4682-a2c3-1dbbda64c220'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-88cc72a3-3d5c-4d55-aea4-efe4e1f632bf tempest-ProjectReaderTests-2033320378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-88cc72a3-3d5c-4d55-aea4-efe4e1f632bf tempest-ProjectReaderTests-2033320378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:35 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-88cc72a3-3d5c-4d55-aea4-efe4e1f632bf tempest-ProjectReaderTests-2033320378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:35 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-88cc72a3-3d5c-4d55-aea4-efe4e1f632bf tempest-ProjectReaderTests-2033320378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-88cc72a3-3d5c-4d55-aea4-efe4e1f632bf tempest-ProjectReaderTests-2033320378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-88cc72a3-3d5c-4d55-aea4-efe4e1f632bf tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:35 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:28:35 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:35 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-88cc72a3-3d5c-4d55-aea4-efe4e1f632bf tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.331s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:35 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-88cc72a3-3d5c-4d55-aea4-efe4e1f632bf tempest-ProjectReaderTests-2033320378 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:28:35 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-88cc72a3-3d5c-4d55-aea4-efe4e1f632bf tempest-ProjectReaderTests-2033320378 None] Deleted volume successfully. Nov 03 13:28:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-88cc72a3-3d5c-4d55-aea4-efe4e1f632bf tempest-ProjectReaderTests-2033320378 None] Lock "cinder-71b3594e-d167-4c51-954f-30ab93466ee3-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-186b1bb4-4698-471e-b05b-737353846266 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-60ae39fc-8de4-46d1-9482-eb82b0ba72f4-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-186b1bb4-4698-471e-b05b-737353846266 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-60ae39fc-8de4-46d1-9482-eb82b0ba72f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-186b1bb4-4698-471e-b05b-737353846266 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-quobyte-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-186b1bb4-4698-471e-b05b-737353846266 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-186b1bb4-4698-471e-b05b-737353846266 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-quobyte-60ae39fc-8de4-46d1-9482-eb82b0ba72f4" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-186b1bb4-4698-471e-b05b-737353846266 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-60ae39fc-8de4-46d1-9482-eb82b0ba72f4" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-186b1bb4-4698-471e-b05b-737353846266 tempest-ProjectMemberTests-1676407320 None] Deleting offline snapshot 60ae39fc-8de4-46d1-9482-eb82b0ba72f4 of volume db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-186b1bb4-4698-471e-b05b-737353846266 tempest-ProjectMemberTests-1676407320 None] snapshot_file for this snap is: volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0.60ae39fc-8de4-46d1-9482-eb82b0ba72f4 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[73110717-5564-41a5-9ba0-1124d00af41a]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-186b1bb4-4698-471e-b05b-737353846266 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0.60ae39fc-8de4-46d1-9482-eb82b0ba72f4 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] Flow 'volume_create_manager' (d0376db5-b773-4c6d-a751-d7e5edeec0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0e8004c-dea5-4ae6-aa9d-fb393b26facd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0e8004c-dea5-4ae6-aa9d-fb393b26facd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1676565580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb758444-6628-4041-af91-e75fa20fa509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d44080166948cea704fa07a936c807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:36Z,use_quota=True,user_id='eaeace3300d748f19b758c594a4c4ee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb770a9e-3544-4bfd-86b4-c7bb550cc29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb770a9e-3544-4bfd-86b4-c7bb550cc29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82955a7c-a8c2-4fc9-926c-1d9eb06bd4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82955a7c-a8c2-4fc9-926c-1d9eb06bd4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb758444-6628-4041-af91-e75fa20fa509', 'volume_name': 'volume-bb758444-6628-4041-af91-e75fa20fa509', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44ca25c2-0718-4138-97a0-4bb776d563ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44ca25c2-0718-4138-97a0-4bb776d563ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e68250f-fb36-4669-99ca-7347a69309bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:36 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] Volume bb758444-6628-4041-af91-e75fa20fa509: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb758444-6628-4041-af91-e75fa20fa509', 'volume_size': 1} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1676565580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb758444-6628-4041-af91-e75fa20fa509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d44080166948cea704fa07a936c807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:36Z,use_quota=True,user_id='eaeace3300d748f19b758c594a4c4ee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] Creating volume bb758444-6628-4041-af91-e75fa20fa509 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:28:36 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:36 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0.60ae39fc-8de4-46d1-9482-eb82b0ba72f4 Nov 03 13:28:36 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:36 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509 1073741824 Nov 03 13:28:36 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Flow 'volume_create_manager' (04eb4a55-1728-42c9-8d99-9ff5657abf14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ee597c2-32e7-42be-8aa3-98942a319e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ee597c2-32e7-42be-8aa3-98942a319e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d85e57-8c43-48cc-9783-04acbcefcab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1ef4bb0a2145a2871342e15c9ed5a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:36Z,use_quota=True,user_id='89e970672dde4b969fe90894b6ae27b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac7220ba-d2e0-40ef-8163-feeb8b3f5cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac7220ba-d2e0-40ef-8163-feeb8b3f5cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b7ba7b3-e361-4a3b-a3fa-05bcf18948ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG cinder.image.glance [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Creating Keystone auth plugin from conf {{(pid=86725) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 13:28:36 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-186b1bb4-4698-471e-b05b-737353846266 tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0.60ae39fc-8de4-46d1-9482-eb82b0ba72f4" returned: 0 in 0.453s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-186b1bb4-4698-471e-b05b-737353846266 tempest-ProjectMemberTests-1676407320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8b50ed-aeea-4d8a-b62c-7a167de67481]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-186b1bb4-4698-471e-b05b-737353846266 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:37 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0 Nov 03 13:28:37 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:37 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509 1073741824" returned: 0 in 0.525s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:37 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509 Nov 03 13:28:37 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b7ba7b3-e361-4a3b-a3fa-05bcf18948ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '42d85e57-8c43-48cc-9783-04acbcefcab5', 'volume_name': 'volume-42d85e57-8c43-48cc-9783-04acbcefcab5', 'volume_size': 1, 'image_id': 'f2247d90-66a1-4f4b-9b00-341d086dd474', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f2247d90-66a1-4f4b-9b00-341d086dd474', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5e3b50703d5f29cd7ea7337756f13de5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6e1ef4bb0a2145a2871342e15c9ed5a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1310c1fe5bd0d0774ee4698d6ae18e130ea6d61dd30e8be0d2809fd764e32835d692ff143337bd65f918d7fca849c490f9c5e96685fa50dd7adbde3c75ddd170', 'id': 'f2247d90-66a1-4f4b-9b00-341d086dd474', 'created_at': datetime.datetime(2026, 11, 3, 12, 28, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 28, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f2247d90-66a1-4f4b-9b00-341d086dd474/file', 'properties': {}}, 'image_service': }' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d779ede-b291-4c28-8e2f-a660f793ee89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d779ede-b291-4c28-8e2f-a660f793ee89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0cce30d-cfdd-4d3e-b415-e589e145a4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:37 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Volume 42d85e57-8c43-48cc-9783-04acbcefcab5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-42d85e57-8c43-48cc-9783-04acbcefcab5', 'volume_size': 1, 'image_id': 'f2247d90-66a1-4f4b-9b00-341d086dd474', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f2247d90-66a1-4f4b-9b00-341d086dd474', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5e3b50703d5f29cd7ea7337756f13de5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6e1ef4bb0a2145a2871342e15c9ed5a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1310c1fe5bd0d0774ee4698d6ae18e130ea6d61dd30e8be0d2809fd764e32835d692ff143337bd65f918d7fca849c490f9c5e96685fa50dd7adbde3c75ddd170', 'id': 'f2247d90-66a1-4f4b-9b00-341d086dd474', 'created_at': datetime.datetime(2026, 11, 3, 12, 28, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 28, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f2247d90-66a1-4f4b-9b00-341d086dd474/file', 'properties': {}}, 'image_service': } Nov 03 13:28:37 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Trying to clone 42d85e57-8c43-48cc-9783-04acbcefcab5 from image f2247d90-66a1-4f4b-9b00-341d086dd474 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f2247d90-66a1-4f4b-9b00-341d086dd474', 'metadata': {}}]). {{(pid=86725) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 13:28:37 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:37 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f2247d90-66a1-4f4b-9b00-341d086dd474_q0vp5tltdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86725) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 13:28:37 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Image download 0.00 MB at 0.00 MB/s Nov 03 13:28:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-186b1bb4-4698-471e-b05b-737353846266 tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0" returned: 0 in 0.558s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-186b1bb4-4698-471e-b05b-737353846266 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0.60ae39fc-8de4-46d1-9482-eb82b0ba72f4 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:37 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509" returned: 0 in 0.367s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:37 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:28:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:37 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0.60ae39fc-8de4-46d1-9482-eb82b0ba72f4 Nov 03 13:28:37 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:37 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[4194a944-a5e0-49f1-a36b-e2de4cc59653]: (4, 'raw') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2247d90-66a1-4f4b-9b00-341d086dd474_q0vp5tltdevstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e68250f-fb36-4669-99ca-7347a69309bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb758444-6628-4041-af91-e75fa20fa509', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ccc68e-36a3-4e25-a2ef-291626610a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:37 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] Volume volume-bb758444-6628-4041-af91-e75fa20fa509 (bb758444-6628-4041-af91-e75fa20fa509): created successfully Nov 03 13:28:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ccc68e-36a3-4e25-a2ef-291626610a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:37 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] Flow 'volume_create_manager' (d0376db5-b773-4c6d-a751-d7e5edeec0a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:37 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-082903e8-c3ab-4099-b34e-55ebda2c29a5 tempest-ProjectReaderTests-2033320378 None] Created volume successfully. Nov 03 13:28:37 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2247d90-66a1-4f4b-9b00-341d086dd474_q0vp5tltdevstack@QuobyteHD Nov 03 13:28:37 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:37 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-186b1bb4-4698-471e-b05b-737353846266 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0.60ae39fc-8de4-46d1-9482-eb82b0ba72f4" returned: 0 in 0.400s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-186b1bb4-4698-471e-b05b-737353846266 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0.60ae39fc-8de4-46d1-9482-eb82b0ba72f4 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:37 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0.60ae39fc-8de4-46d1-9482-eb82b0ba72f4 Nov 03 13:28:37 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:37 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2247d90-66a1-4f4b-9b00-341d086dd474_q0vp5tltdevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2247d90-66a1-4f4b-9b00-341d086dd474_q0vp5tltdevstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:37 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2247d90-66a1-4f4b-9b00-341d086dd474_q0vp5tltdevstack@QuobyteHD Nov 03 13:28:37 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:38 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-186b1bb4-4698-471e-b05b-737353846266 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0.60ae39fc-8de4-46d1-9482-eb82b0ba72f4" returned: 0 in 0.284s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:38 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-186b1bb4-4698-471e-b05b-737353846266 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-60ae39fc-8de4-46d1-9482-eb82b0ba72f4" released by "_delete_snapshot" :: held 1.860s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:38 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-186b1bb4-4698-471e-b05b-737353846266 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0" released by "delete_snapshot" :: held 1.905s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:38 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2247d90-66a1-4f4b-9b00-341d086dd474_q0vp5tltdevstack@QuobyteHD" returned: 1 in 0.379s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2247d90-66a1-4f4b-9b00-341d086dd474_q0vp5tltdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:28:38 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Temporary image f2247d90-66a1-4f4b-9b00-341d086dd474 is fetched for user 89e970672dde4b969fe90894b6ae27b7. {{(pid=86725) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 13:28:38 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-186b1bb4-4698-471e-b05b-737353846266 tempest-ProjectMemberTests-1676407320 None] Created reservations ['db7dab6b-f994-4bae-9584-b0560dcca0b1', '822099cb-6b7c-4b28-87e8-0df7cd99b776', '68433787-3273-498b-8e47-c59b1b28115b', '3acfb42e-6b40-486a-8a49-1b6b104be25f'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:38 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-186b1bb4-4698-471e-b05b-737353846266 tempest-ProjectMemberTests-1676407320 None] Delete snapshot completed successfully. Nov 03 13:28:38 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37781a0-d982-47d5-825f-6e4a98fd75fb]: (4, 'raw') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2247d90-66a1-4f4b-9b00-341d086dd474_q0vp5tltdevstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:38 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-186b1bb4-4698-471e-b05b-737353846266 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-60ae39fc-8de4-46d1-9482-eb82b0ba72f4-delete_snapshot" released by "delete_snapshot" :: held 2.136s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:38 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2247d90-66a1-4f4b-9b00-341d086dd474_q0vp5tltdevstack@QuobyteHD Nov 03 13:28:38 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:38 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4056e4c9-83b9-4930-a5fb-14ebec7c725c tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:38 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4056e4c9-83b9-4930-a5fb-14ebec7c725c tempest-ProjectMemberTests-1676407320 None] Lock "cinder-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b689614d-b642-4c90-916d-60ec0576f1e3 tempest-ProjectReaderTests-2033320378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b689614d-b642-4c90-916d-60ec0576f1e3 tempest-ProjectReaderTests-2033320378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:38 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4056e4c9-83b9-4930-a5fb-14ebec7c725c tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-quobyte-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:38 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-b689614d-b642-4c90-916d-60ec0576f1e3 tempest-ProjectReaderTests-2033320378 None] Creating offline snapshot b6f94d20-5c5e-4742-932a-913108160d22 of volume bb758444-6628-4041-af91-e75fa20fa509 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:28:38 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4056e4c9-83b9-4930-a5fb-14ebec7c725c tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0" acquired by "delete_volume" :: waited 0.033s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:38 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fea485-3726-4c66-9118-0659bd8e65f4]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b689614d-b642-4c90-916d-60ec0576f1e3 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:38 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[4719b2f1-6e2b-4e60-8681-cbd9e34d4ad1]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4056e4c9-83b9-4930-a5fb-14ebec7c725c tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:38 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2247d90-66a1-4f4b-9b00-341d086dd474_q0vp5tltdevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2247d90-66a1-4f4b-9b00-341d086dd474_q0vp5tltdevstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:38 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509 Nov 03 13:28:38 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:38 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0 Nov 03 13:28:38 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:38 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2247d90-66a1-4f4b-9b00-341d086dd474_q0vp5tltdevstack@QuobyteHD Nov 03 13:28:38 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:39 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b689614d-b642-4c90-916d-60ec0576f1e3 tempest-ProjectReaderTests-2033320378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509" returned: 0 in 0.431s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b689614d-b642-4c90-916d-60ec0576f1e3 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509.b6f94d20-5c5e-4742-932a-913108160d22 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:39 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:39 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4056e4c9-83b9-4930-a5fb-14ebec7c725c tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0" returned: 0 in 0.427s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4056e4c9-83b9-4930-a5fb-14ebec7c725c tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2247d90-66a1-4f4b-9b00-341d086dd474_q0vp5tltdevstack@QuobyteHD" returned: 1 in 0.412s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2247d90-66a1-4f4b-9b00-341d086dd474_q0vp5tltdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:28:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:39 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509.b6f94d20-5c5e-4742-932a-913108160d22 1G Nov 03 13:28:39 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:39 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0 Nov 03 13:28:39 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:39 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4056e4c9-83b9-4930-a5fb-14ebec7c725c tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0" returned: 0 in 0.305s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:39 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4056e4c9-83b9-4930-a5fb-14ebec7c725c tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0" released by "delete_volume" :: held 0.825s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:39 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-4056e4c9-83b9-4930-a5fb-14ebec7c725c tempest-ProjectMemberTests-1676407320 None] Created reservations ['fa1b4ba6-1712-4e85-b69d-882c1d199543', 'ca1804aa-de58-49a5-9bc6-a1bf170c2d3f', '0fb7d7aa-8e8b-420e-a699-a0a4c8bc1505', 'eddddb1b-8e09-4c3a-a14a-aee90d8cd7c9'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4056e4c9-83b9-4930-a5fb-14ebec7c725c tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4056e4c9-83b9-4930-a5fb-14ebec7c725c tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:39 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4056e4c9-83b9-4930-a5fb-14ebec7c725c tempest-ProjectMemberTests-1676407320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:39 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4056e4c9-83b9-4930-a5fb-14ebec7c725c tempest-ProjectMemberTests-1676407320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4056e4c9-83b9-4930-a5fb-14ebec7c725c tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4056e4c9-83b9-4930-a5fb-14ebec7c725c tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:39 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b689614d-b642-4c90-916d-60ec0576f1e3 tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509.b6f94d20-5c5e-4742-932a-913108160d22 1G" returned: 0 in 0.502s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b689614d-b642-4c90-916d-60ec0576f1e3 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb758444-6628-4041-af91-e75fa20fa509 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509.b6f94d20-5c5e-4742-932a-913108160d22 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:39 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:28:39 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:39 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb758444-6628-4041-af91-e75fa20fa509 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509.b6f94d20-5c5e-4742-932a-913108160d22 Nov 03 13:28:39 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:39 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4056e4c9-83b9-4930-a5fb-14ebec7c725c tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.250s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:39 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-4056e4c9-83b9-4930-a5fb-14ebec7c725c tempest-ProjectMemberTests-1676407320 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:28:39 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-4056e4c9-83b9-4930-a5fb-14ebec7c725c tempest-ProjectMemberTests-1676407320 None] Deleted volume successfully. Nov 03 13:28:39 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4056e4c9-83b9-4930-a5fb-14ebec7c725c tempest-ProjectMemberTests-1676407320 None] Lock "cinder-db49a9ed-bd18-4e3b-9766-e09f0dbfcfc0-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:40 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b689614d-b642-4c90-916d-60ec0576f1e3 tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb758444-6628-4041-af91-e75fa20fa509 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509.b6f94d20-5c5e-4742-932a-913108160d22" returned: 0 in 0.328s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:40 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-b689614d-b642-4c90-916d-60ec0576f1e3 tempest-ProjectReaderTests-2033320378 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509.b6f94d20-5c5e-4742-932a-913108160d22 is being set with open permissions: ugo+rw Nov 03 13:28:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b689614d-b642-4c90-916d-60ec0576f1e3 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509.b6f94d20-5c5e-4742-932a-913108160d22 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:40 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509.b6f94d20-5c5e-4742-932a-913108160d22 Nov 03 13:28:40 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:40 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:28:40 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] Flow 'volume_create_manager' (cd01d145-919b-45fd-8c4e-8a75b0839e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:40 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc6cc855-5460-4b34-93cf-7433cc3e5719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:40 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc6cc855-5460-4b34-93cf-7433cc3e5719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-545132399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5c7d4f5-701d-403c-93b7-446dc4f4cc59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60ac3b296fa402ebc45563747540073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:40Z,use_quota=True,user_id='82e28082879940beb510c24ff3452f75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:40 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55219579-ebed-49d9-9c2d-cf90d2b40a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:40 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55219579-ebed-49d9-9c2d-cf90d2b40a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:40 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9bd6b31-563e-4058-b797-d3295bfefcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:40 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:40 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9bd6b31-563e-4058-b797-d3295bfefcba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5c7d4f5-701d-403c-93b7-446dc4f4cc59', 'volume_name': 'volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:40 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7b5f159-7ab5-4d26-bf6a-420715778b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:40 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7b5f159-7ab5-4d26-bf6a-420715778b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:40 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97beba7d-b187-4ef0-b283-890d0e4d2e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:40 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] Volume f5c7d4f5-701d-403c-93b7-446dc4f4cc59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59', 'volume_size': 1} Nov 03 13:28:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b689614d-b642-4c90-916d-60ec0576f1e3 tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509.b6f94d20-5c5e-4742-932a-913108160d22" returned: 0 in 0.269s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b689614d-b642-4c90-916d-60ec0576f1e3 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:40 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509.info Nov 03 13:28:40 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:40 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b689614d-b642-4c90-916d-60ec0576f1e3 tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509.info" returned: 0 in 0.258s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:40 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-b689614d-b642-4c90-916d-60ec0576f1e3 tempest-ProjectReaderTests-2033320378 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509.info is being set with open permissions: ugo+rw Nov 03 13:28:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b689614d-b642-4c90-916d-60ec0576f1e3 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:40 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509.info Nov 03 13:28:40 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:40 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b689614d-b642-4c90-916d-60ec0576f1e3 tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509.info" returned: 0 in 0.260s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b689614d-b642-4c90-916d-60ec0576f1e3 tempest-ProjectReaderTests-2033320378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.180s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.626s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:40 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d85e57-8c43-48cc-9783-04acbcefcab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1ef4bb0a2145a2871342e15c9ed5a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:36Z,use_quota=True,user_id='89e970672dde4b969fe90894b6ae27b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:28:40 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Creating volume 42d85e57-8c43-48cc-9783-04acbcefcab5 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:28:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:40 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:40 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:40 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:28:40 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:28:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-42d85e57-8c43-48cc-9783-04acbcefcab5 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:40 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-42d85e57-8c43-48cc-9783-04acbcefcab5 1073741824 Nov 03 13:28:40 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:40 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-b689614d-b642-4c90-916d-60ec0576f1e3 tempest-ProjectReaderTests-2033320378 None] Create snapshot completed successfully Nov 03 13:28:41 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-42d85e57-8c43-48cc-9783-04acbcefcab5 1073741824" returned: 0 in 0.472s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-42d85e57-8c43-48cc-9783-04acbcefcab5 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:41 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-42d85e57-8c43-48cc-9783-04acbcefcab5 Nov 03 13:28:41 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:41 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-42d85e57-8c43-48cc-9783-04acbcefcab5" returned: 0 in 0.255s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:41 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:28:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.347s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:41 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-545132399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5c7d4f5-701d-403c-93b7-446dc4f4cc59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60ac3b296fa402ebc45563747540073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:40Z,use_quota=True,user_id='82e28082879940beb510c24ff3452f75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:28:41 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] Creating volume f5c7d4f5-701d-403c-93b7-446dc4f4cc59 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:28:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:41 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:41 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:41 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:28:41 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:28:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:41 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59 1073741824 Nov 03 13:28:41 devstack cinder-volume[86725]: DEBUG cinder.volume.volume_utils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Attempting download of f2247d90-66a1-4f4b-9b00-341d086dd474 ((None, [{'url': 'file:///opt/stack/data/glance/images/f2247d90-66a1-4f4b-9b00-341d086dd474', 'metadata': {}}])) to volume 42d85e57-8c43-48cc-9783-04acbcefcab5. {{(pid=86725) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 13:28:41 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:41 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b22ca16-e28b-4265-83fb-316cca83c583]: (4, 'raw') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f2247d90-66a1-4f4b-9b00-341d086dd474_brmg6hwv {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:41 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d4eaa639-53fe-4b8d-8885-91eee7fe17e1 tempest-ProjectReaderTests-2033320378 None] Acquiring lock "cinder-b6f94d20-5c5e-4742-932a-913108160d22-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:41 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d4eaa639-53fe-4b8d-8885-91eee7fe17e1 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-b6f94d20-5c5e-4742-932a-913108160d22-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:41 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d4eaa639-53fe-4b8d-8885-91eee7fe17e1 tempest-ProjectReaderTests-2033320378 None] Acquiring lock "cinder-quobyte-bb758444-6628-4041-af91-e75fa20fa509" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:41 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d4eaa639-53fe-4b8d-8885-91eee7fe17e1 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-quobyte-bb758444-6628-4041-af91-e75fa20fa509" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:41 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d4eaa639-53fe-4b8d-8885-91eee7fe17e1 tempest-ProjectReaderTests-2033320378 None] Acquiring lock "cinder-quobyte-b6f94d20-5c5e-4742-932a-913108160d22" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:41 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f2247d90-66a1-4f4b-9b00-341d086dd474_brmg6hwv Nov 03 13:28:41 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:41 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d4eaa639-53fe-4b8d-8885-91eee7fe17e1 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-quobyte-b6f94d20-5c5e-4742-932a-913108160d22" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:41 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-d4eaa639-53fe-4b8d-8885-91eee7fe17e1 tempest-ProjectReaderTests-2033320378 None] Deleting offline snapshot b6f94d20-5c5e-4742-932a-913108160d22 of volume bb758444-6628-4041-af91-e75fa20fa509 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:28:41 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-d4eaa639-53fe-4b8d-8885-91eee7fe17e1 tempest-ProjectReaderTests-2033320378 None] snapshot_file for this snap is: volume-bb758444-6628-4041-af91-e75fa20fa509.b6f94d20-5c5e-4742-932a-913108160d22 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:28:41 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[94937c0a-14b0-4778-957c-e3ff149a43a1]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d4eaa639-53fe-4b8d-8885-91eee7fe17e1 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509.b6f94d20-5c5e-4742-932a-913108160d22 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:42 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509.b6f94d20-5c5e-4742-932a-913108160d22 Nov 03 13:28:42 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:42 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59 1073741824" returned: 0 in 0.427s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:42 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f2247d90-66a1-4f4b-9b00-341d086dd474_brmg6hwv" returned: 0 in 0.363s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f2247d90-66a1-4f4b-9b00-341d086dd474_brmg6hwv {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:42 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59 Nov 03 13:28:42 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:42 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f2247d90-66a1-4f4b-9b00-341d086dd474_brmg6hwv Nov 03 13:28:42 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:42 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d4eaa639-53fe-4b8d-8885-91eee7fe17e1 tempest-ProjectReaderTests-2033320378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509.b6f94d20-5c5e-4742-932a-913108160d22" returned: 0 in 0.442s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:42 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-d4eaa639-53fe-4b8d-8885-91eee7fe17e1 tempest-ProjectReaderTests-2033320378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb758444-6628-4041-af91-e75fa20fa509(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:28:42 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0833c81-4c8f-47e4-a32f-8cf6e78d582f]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d4eaa639-53fe-4b8d-8885-91eee7fe17e1 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:42 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59" returned: 0 in 0.310s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:42 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:28:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97beba7d-b187-4ef0-b283-890d0e4d2e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed51df94-5e3f-4b99-ba04-effa7b4b07dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:42 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] Volume volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59 (f5c7d4f5-701d-403c-93b7-446dc4f4cc59): created successfully Nov 03 13:28:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed51df94-5e3f-4b99-ba04-effa7b4b07dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:42 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] Flow 'volume_create_manager' (cd01d145-919b-45fd-8c4e-8a75b0839e0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:42 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f2247d90-66a1-4f4b-9b00-341d086dd474_brmg6hwv" returned: 1 in 0.392s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f2247d90-66a1-4f4b-9b00-341d086dd474_brmg6hwv' failed. Not Retrying. {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:28:42 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09bf301-d6c8-4e8f-988b-5db7b848b75c]: (4, 'raw') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2247d90-66a1-4f4b-9b00-341d086dd474_q0vp5tltdevstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:42 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-4f1f191a-b5c9-46a8-a6d5-57793c16d725 tempest-ProjectMemberTests-1676407320 None] Created volume successfully. Nov 03 13:28:42 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509 Nov 03 13:28:42 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:42 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2247d90-66a1-4f4b-9b00-341d086dd474_q0vp5tltdevstack@QuobyteHD Nov 03 13:28:42 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:42 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d4eaa639-53fe-4b8d-8885-91eee7fe17e1 tempest-ProjectReaderTests-2033320378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509" returned: 0 in 0.403s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d4eaa639-53fe-4b8d-8885-91eee7fe17e1 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509.b6f94d20-5c5e-4742-932a-913108160d22 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:42 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509.b6f94d20-5c5e-4742-932a-913108160d22 Nov 03 13:28:42 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:42 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2247d90-66a1-4f4b-9b00-341d086dd474_q0vp5tltdevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2247d90-66a1-4f4b-9b00-341d086dd474_q0vp5tltdevstack@QuobyteHD {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:43 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2247d90-66a1-4f4b-9b00-341d086dd474_q0vp5tltdevstack@QuobyteHD Nov 03 13:28:43 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:43 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d4eaa639-53fe-4b8d-8885-91eee7fe17e1 tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509.b6f94d20-5c5e-4742-932a-913108160d22" returned: 0 in 0.371s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d4eaa639-53fe-4b8d-8885-91eee7fe17e1 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509.b6f94d20-5c5e-4742-932a-913108160d22 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:43 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509.b6f94d20-5c5e-4742-932a-913108160d22 Nov 03 13:28:43 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:43 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2247d90-66a1-4f4b-9b00-341d086dd474_q0vp5tltdevstack@QuobyteHD" returned: 1 in 0.346s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2247d90-66a1-4f4b-9b00-341d086dd474_q0vp5tltdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:28:43 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] f2247d90-66a1-4f4b-9b00-341d086dd474 was raw, converting to qcow2 {{(pid=86725) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 13:28:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f2247d90-66a1-4f4b-9b00-341d086dd474_q0vp5tltdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-42d85e57-8c43-48cc-9783-04acbcefcab5 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:43 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f2247d90-66a1-4f4b-9b00-341d086dd474_q0vp5tltdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-42d85e57-8c43-48cc-9783-04acbcefcab5 Nov 03 13:28:43 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:43 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d4eaa639-53fe-4b8d-8885-91eee7fe17e1 tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509.b6f94d20-5c5e-4742-932a-913108160d22" returned: 0 in 0.308s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:43 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d4eaa639-53fe-4b8d-8885-91eee7fe17e1 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-quobyte-b6f94d20-5c5e-4742-932a-913108160d22" released by "_delete_snapshot" :: held 1.689s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:43 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d4eaa639-53fe-4b8d-8885-91eee7fe17e1 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-quobyte-bb758444-6628-4041-af91-e75fa20fa509" released by "delete_snapshot" :: held 1.725s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-bbb5a9e8-bcbb-4674-8d2c-c70337bca6d2 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-bbb5a9e8-bcbb-4674-8d2c-c70337bca6d2 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:43 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-bbb5a9e8-bcbb-4674-8d2c-c70337bca6d2 tempest-ProjectMemberTests-1676407320 None] Creating offline snapshot 87cb4afd-4be5-43fd-91e7-5d8096325311 of volume f5c7d4f5-701d-403c-93b7-446dc4f4cc59 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:28:43 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d25f3d8-02aa-4fa3-b196-43efe83a7ddc]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-bbb5a9e8-bcbb-4674-8d2c-c70337bca6d2 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:43 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-d4eaa639-53fe-4b8d-8885-91eee7fe17e1 tempest-ProjectReaderTests-2033320378 None] Created reservations ['eba28dc4-46fb-4533-adb8-d241e4c89c51', '54cf8d59-088d-4ec5-aecd-cc682e659951', 'e23230a0-d6bd-465d-8afc-af6682a5cc4e', 'ef7df695-9af5-4a6b-9e72-5167d90e4ea2'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:43 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-d4eaa639-53fe-4b8d-8885-91eee7fe17e1 tempest-ProjectReaderTests-2033320378 None] Delete snapshot completed successfully. Nov 03 13:28:43 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d4eaa639-53fe-4b8d-8885-91eee7fe17e1 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-b6f94d20-5c5e-4742-932a-913108160d22-delete_snapshot" released by "delete_snapshot" :: held 1.999s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:43 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59 Nov 03 13:28:43 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:43 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f2247d90-66a1-4f4b-9b00-341d086dd474_q0vp5tltdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-42d85e57-8c43-48cc-9783-04acbcefcab5" returned: 0 in 0.630s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:43 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f2247d90-66a1-4f4b-9b00-341d086dd474_q0vp5tltdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-42d85e57-8c43-48cc-9783-04acbcefcab5 {{(pid=86725) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:28:43 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 13:28:43 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-42d85e57-8c43-48cc-9783-04acbcefcab5 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:43 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-42d85e57-8c43-48cc-9783-04acbcefcab5 1G Nov 03 13:28:43 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:44 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-7c9ebc22-e2f4-4ad4-bba7-6c3d8ed040f2 tempest-ProjectReaderTests-2033320378 None] Acquiring lock "cinder-bb758444-6628-4041-af91-e75fa20fa509-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:44 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-7c9ebc22-e2f4-4ad4-bba7-6c3d8ed040f2 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-bb758444-6628-4041-af91-e75fa20fa509-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:44 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-7c9ebc22-e2f4-4ad4-bba7-6c3d8ed040f2 tempest-ProjectReaderTests-2033320378 None] Acquiring lock "cinder-quobyte-bb758444-6628-4041-af91-e75fa20fa509" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:44 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-7c9ebc22-e2f4-4ad4-bba7-6c3d8ed040f2 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-quobyte-bb758444-6628-4041-af91-e75fa20fa509" acquired by "delete_volume" :: waited 0.035s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:44 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c92682e-1cdc-4b67-b2a0-565ea8f026c4]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7c9ebc22-e2f4-4ad4-bba7-6c3d8ed040f2 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:44 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-bbb5a9e8-bcbb-4674-8d2c-c70337bca6d2 tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59" returned: 0 in 0.496s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-bbb5a9e8-bcbb-4674-8d2c-c70337bca6d2 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59.87cb4afd-4be5-43fd-91e7-5d8096325311 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:44 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59.87cb4afd-4be5-43fd-91e7-5d8096325311 1G Nov 03 13:28:44 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:44 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509 Nov 03 13:28:44 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:44 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-42d85e57-8c43-48cc-9783-04acbcefcab5 1G" returned: 0 in 0.463s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:44 devstack cinder-volume[86725]: DEBUG cinder.volume.volume_utils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Downloaded image f2247d90-66a1-4f4b-9b00-341d086dd474 ((None, [{'url': 'file:///opt/stack/data/glance/images/f2247d90-66a1-4f4b-9b00-341d086dd474', 'metadata': {}}])) to volume 42d85e57-8c43-48cc-9783-04acbcefcab5 successfully. {{(pid=86725) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 13:28:44 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Temporary image f2247d90-66a1-4f4b-9b00-341d086dd474 for user 89e970672dde4b969fe90894b6ae27b7 is deleted. {{(pid=86725) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 13:28:44 devstack cinder-volume[86725]: DEBUG cinder.volume.volume_utils [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Marking volume 42d85e57-8c43-48cc-9783-04acbcefcab5 as bootable. {{(pid=86725) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 13:28:44 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Copying metadata from image f2247d90-66a1-4f4b-9b00-341d086dd474 to 42d85e57-8c43-48cc-9783-04acbcefcab5. {{(pid=86725) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 13:28:44 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Creating volume glance metadata for volume 42d85e57-8c43-48cc-9783-04acbcefcab5 backed by image f2247d90-66a1-4f4b-9b00-341d086dd474 with: {'image_id': 'f2247d90-66a1-4f4b-9b00-341d086dd474', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5e3b50703d5f29cd7ea7337756f13de5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86725) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 13:28:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0cce30d-cfdd-4d3e-b415-e589e145a4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42d85e57-8c43-48cc-9783-04acbcefcab5', 'volume_size': 1, 'image_id': 'f2247d90-66a1-4f4b-9b00-341d086dd474', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f2247d90-66a1-4f4b-9b00-341d086dd474', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5e3b50703d5f29cd7ea7337756f13de5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6e1ef4bb0a2145a2871342e15c9ed5a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1310c1fe5bd0d0774ee4698d6ae18e130ea6d61dd30e8be0d2809fd764e32835d692ff143337bd65f918d7fca849c490f9c5e96685fa50dd7adbde3c75ddd170', 'id': 'f2247d90-66a1-4f4b-9b00-341d086dd474', 'created_at': datetime.datetime(2026, 11, 3, 12, 28, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 28, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f2247d90-66a1-4f4b-9b00-341d086dd474/file', 'properties': {}}, 'image_service': }' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (449f0d6d-8051-4f46-a421-f678667025ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:44 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Volume volume-42d85e57-8c43-48cc-9783-04acbcefcab5 (42d85e57-8c43-48cc-9783-04acbcefcab5): created successfully Nov 03 13:28:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (449f0d6d-8051-4f46-a421-f678667025ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:44 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Flow 'volume_create_manager' (04eb4a55-1728-42c9-8d99-9ff5657abf14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:44 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-f12d835f-804e-432c-a813-1a1610ffe921 tempest-VolumeImageDependencyTests-76135331 None] Created volume successfully. Nov 03 13:28:44 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7c9ebc22-e2f4-4ad4-bba7-6c3d8ed040f2 tempest-ProjectReaderTests-2033320378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509" returned: 0 in 0.441s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7c9ebc22-e2f4-4ad4-bba7-6c3d8ed040f2 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:44 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509 Nov 03 13:28:44 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:44 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-bbb5a9e8-bcbb-4674-8d2c-c70337bca6d2 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59.87cb4afd-4be5-43fd-91e7-5d8096325311 1G" returned: 0 in 0.531s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-bbb5a9e8-bcbb-4674-8d2c-c70337bca6d2 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59.87cb4afd-4be5-43fd-91e7-5d8096325311 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:44 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59.87cb4afd-4be5-43fd-91e7-5d8096325311 Nov 03 13:28:44 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:44 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:44 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7c9ebc22-e2f4-4ad4-bba7-6c3d8ed040f2 tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb758444-6628-4041-af91-e75fa20fa509" returned: 0 in 0.273s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:44 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-7c9ebc22-e2f4-4ad4-bba7-6c3d8ed040f2 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-quobyte-bb758444-6628-4041-af91-e75fa20fa509" released by "delete_volume" :: held 0.802s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-7c9ebc22-e2f4-4ad4-bba7-6c3d8ed040f2 tempest-ProjectReaderTests-2033320378 None] Created reservations ['f2d5cab6-ee70-414c-b870-b97da005b94f', 'a060a87c-0da3-4184-9a42-2f95a887ce90', 'c3931cf7-81c0-4aad-a04c-2099b6c7b115', '401ed88a-4437-4730-9d05-c0a499f5b539'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-86185caf-f452-47da-b5f2-d8dc86ffffa6 tempest-VolumeImageDependencyTests-76135331 None] Acquiring lock "cinder-42d85e57-8c43-48cc-9783-04acbcefcab5-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-86185caf-f452-47da-b5f2-d8dc86ffffa6 tempest-VolumeImageDependencyTests-76135331 None] Lock "cinder-42d85e57-8c43-48cc-9783-04acbcefcab5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7c9ebc22-e2f4-4ad4-bba7-6c3d8ed040f2 tempest-ProjectReaderTests-2033320378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7c9ebc22-e2f4-4ad4-bba7-6c3d8ed040f2 tempest-ProjectReaderTests-2033320378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7c9ebc22-e2f4-4ad4-bba7-6c3d8ed040f2 tempest-ProjectReaderTests-2033320378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:45 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7c9ebc22-e2f4-4ad4-bba7-6c3d8ed040f2 tempest-ProjectReaderTests-2033320378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7c9ebc22-e2f4-4ad4-bba7-6c3d8ed040f2 tempest-ProjectReaderTests-2033320378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7c9ebc22-e2f4-4ad4-bba7-6c3d8ed040f2 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-bbb5a9e8-bcbb-4674-8d2c-c70337bca6d2 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59.87cb4afd-4be5-43fd-91e7-5d8096325311" returned: 0 in 0.417s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:45 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-bbb5a9e8-bcbb-4674-8d2c-c70337bca6d2 tempest-ProjectMemberTests-1676407320 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59.87cb4afd-4be5-43fd-91e7-5d8096325311 is being set with open permissions: ugo+rw Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-bbb5a9e8-bcbb-4674-8d2c-c70337bca6d2 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59.87cb4afd-4be5-43fd-91e7-5d8096325311 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:45 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:28:45 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:45 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59.87cb4afd-4be5-43fd-91e7-5d8096325311 Nov 03 13:28:45 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-86185caf-f452-47da-b5f2-d8dc86ffffa6 tempest-VolumeImageDependencyTests-76135331 None] Acquiring lock "cinder-quobyte-42d85e57-8c43-48cc-9783-04acbcefcab5" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-86185caf-f452-47da-b5f2-d8dc86ffffa6 tempest-VolumeImageDependencyTests-76135331 None] Lock "cinder-quobyte-42d85e57-8c43-48cc-9783-04acbcefcab5" acquired by "delete_volume" :: waited 0.041s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2fa263-3328-4f86-b50e-95439c288c66]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-86185caf-f452-47da-b5f2-d8dc86ffffa6 tempest-VolumeImageDependencyTests-76135331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-42d85e57-8c43-48cc-9783-04acbcefcab5 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:45 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-bbb5a9e8-bcbb-4674-8d2c-c70337bca6d2 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59.87cb4afd-4be5-43fd-91e7-5d8096325311" returned: 0 in 0.318s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-bbb5a9e8-bcbb-4674-8d2c-c70337bca6d2 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:45 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-42d85e57-8c43-48cc-9783-04acbcefcab5 Nov 03 13:28:45 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:45 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59.info Nov 03 13:28:45 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:45 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7c9ebc22-e2f4-4ad4-bba7-6c3d8ed040f2 tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.471s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-7c9ebc22-e2f4-4ad4-bba7-6c3d8ed040f2 tempest-ProjectReaderTests-2033320378 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:28:45 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-7c9ebc22-e2f4-4ad4-bba7-6c3d8ed040f2 tempest-ProjectReaderTests-2033320378 None] Deleted volume successfully. Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-7c9ebc22-e2f4-4ad4-bba7-6c3d8ed040f2 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-bb758444-6628-4041-af91-e75fa20fa509-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:45 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-bbb5a9e8-bcbb-4674-8d2c-c70337bca6d2 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59.info" returned: 0 in 0.315s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:45 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-bbb5a9e8-bcbb-4674-8d2c-c70337bca6d2 tempest-ProjectMemberTests-1676407320 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59.info is being set with open permissions: ugo+rw Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-bbb5a9e8-bcbb-4674-8d2c-c70337bca6d2 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:45 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:45 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59.info Nov 03 13:28:45 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-86185caf-f452-47da-b5f2-d8dc86ffffa6 tempest-VolumeImageDependencyTests-76135331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-42d85e57-8c43-48cc-9783-04acbcefcab5" returned: 0 in 0.551s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-86185caf-f452-47da-b5f2-d8dc86ffffa6 tempest-VolumeImageDependencyTests-76135331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-42d85e57-8c43-48cc-9783-04acbcefcab5 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:28:45 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-42d85e57-8c43-48cc-9783-04acbcefcab5 Nov 03 13:28:45 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] Flow 'volume_create_manager' (e10a6d78-b802-4a12-9242-367178c18336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfc29e8a-bf3c-4223-8e0f-f79cfc68e3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfc29e8a-bf3c-4223-8e0f-f79cfc68e3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1907941327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23a5f5cd-d41b-4f28-b809-4ff213b1c178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d44080166948cea704fa07a936c807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:46Z,use_quota=True,user_id='eaeace3300d748f19b758c594a4c4ee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64a55d44-45e8-469a-972d-7ecbdf1f4455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64a55d44-45e8-469a-972d-7ecbdf1f4455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (536aff2a-0110-4f30-8ca4-86c485adc438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (536aff2a-0110-4f30-8ca4-86c485adc438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23a5f5cd-d41b-4f28-b809-4ff213b1c178', 'volume_name': 'volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7417404-0456-4fcf-b604-0e42c75bd8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7417404-0456-4fcf-b604-0e42c75bd8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5220e926-6dd3-4766-8d5d-657923a05e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:45 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] Volume 23a5f5cd-d41b-4f28-b809-4ff213b1c178: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178', 'volume_size': 1} Nov 03 13:28:45 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:46 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-bbb5a9e8-bcbb-4674-8d2c-c70337bca6d2 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59.info" returned: 0 in 0.264s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-bbb5a9e8-bcbb-4674-8d2c-c70337bca6d2 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.467s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.139s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1907941327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23a5f5cd-d41b-4f28-b809-4ff213b1c178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d44080166948cea704fa07a936c807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:46Z,use_quota=True,user_id='eaeace3300d748f19b758c594a4c4ee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] Creating volume 23a5f5cd-d41b-4f28-b809-4ff213b1c178 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:46 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:28:46 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-86185caf-f452-47da-b5f2-d8dc86ffffa6 tempest-VolumeImageDependencyTests-76135331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-42d85e57-8c43-48cc-9783-04acbcefcab5" returned: 0 in 0.282s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:46 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178 1073741824 Nov 03 13:28:46 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-86185caf-f452-47da-b5f2-d8dc86ffffa6 tempest-VolumeImageDependencyTests-76135331 None] Lock "cinder-quobyte-42d85e57-8c43-48cc-9783-04acbcefcab5" released by "delete_volume" :: held 0.909s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:46 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-bbb5a9e8-bcbb-4674-8d2c-c70337bca6d2 tempest-ProjectMemberTests-1676407320 None] Create snapshot completed successfully Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-86185caf-f452-47da-b5f2-d8dc86ffffa6 tempest-VolumeImageDependencyTests-76135331 None] Created reservations ['0ba2948f-e1da-4016-90e7-21e2650aea18', '6575d23a-8045-414a-a321-5469a8eb4aa1', 'ee44a2cb-b61e-48b8-a042-055ef106f9d3', '571018e2-2a7d-46ee-9d5a-22ef05955d0a'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-86185caf-f452-47da-b5f2-d8dc86ffffa6 tempest-VolumeImageDependencyTests-76135331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-86185caf-f452-47da-b5f2-d8dc86ffffa6 tempest-VolumeImageDependencyTests-76135331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-86185caf-f452-47da-b5f2-d8dc86ffffa6 tempest-VolumeImageDependencyTests-76135331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-86185caf-f452-47da-b5f2-d8dc86ffffa6 tempest-VolumeImageDependencyTests-76135331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-86185caf-f452-47da-b5f2-d8dc86ffffa6 tempest-VolumeImageDependencyTests-76135331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-86185caf-f452-47da-b5f2-d8dc86ffffa6 tempest-VolumeImageDependencyTests-76135331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:46 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:28:46 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:46 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178 1073741824" returned: 0 in 0.472s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:46 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-86185caf-f452-47da-b5f2-d8dc86ffffa6 tempest-VolumeImageDependencyTests-76135331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.270s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-86185caf-f452-47da-b5f2-d8dc86ffffa6 tempest-VolumeImageDependencyTests-76135331 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:28:46 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-86185caf-f452-47da-b5f2-d8dc86ffffa6 tempest-VolumeImageDependencyTests-76135331 None] Deleted volume successfully. Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-86185caf-f452-47da-b5f2-d8dc86ffffa6 tempest-VolumeImageDependencyTests-76135331 None] Lock "cinder-42d85e57-8c43-48cc-9783-04acbcefcab5-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:46 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178 Nov 03 13:28:46 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4fc8f853-ebf0-4ac8-a2d7-6139685f9222 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-87cb4afd-4be5-43fd-91e7-5d8096325311-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4fc8f853-ebf0-4ac8-a2d7-6139685f9222 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-87cb4afd-4be5-43fd-91e7-5d8096325311-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4fc8f853-ebf0-4ac8-a2d7-6139685f9222 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-quobyte-f5c7d4f5-701d-403c-93b7-446dc4f4cc59" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4fc8f853-ebf0-4ac8-a2d7-6139685f9222 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-f5c7d4f5-701d-403c-93b7-446dc4f4cc59" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4fc8f853-ebf0-4ac8-a2d7-6139685f9222 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-quobyte-87cb4afd-4be5-43fd-91e7-5d8096325311" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4fc8f853-ebf0-4ac8-a2d7-6139685f9222 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-87cb4afd-4be5-43fd-91e7-5d8096325311" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-4fc8f853-ebf0-4ac8-a2d7-6139685f9222 tempest-ProjectMemberTests-1676407320 None] Deleting offline snapshot 87cb4afd-4be5-43fd-91e7-5d8096325311 of volume f5c7d4f5-701d-403c-93b7-446dc4f4cc59 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:28:46 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-4fc8f853-ebf0-4ac8-a2d7-6139685f9222 tempest-ProjectMemberTests-1676407320 None] snapshot_file for this snap is: volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59.87cb4afd-4be5-43fd-91e7-5d8096325311 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178" returned: 0 in 0.284s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73c1260-23c2-4ea3-a0c5-f05e0e8921e2]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4fc8f853-ebf0-4ac8-a2d7-6139685f9222 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59.87cb4afd-4be5-43fd-91e7-5d8096325311 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5220e926-6dd3-4766-8d5d-657923a05e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:46 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (504d6213-eea0-4476-accd-41373c0a6254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:46 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] Volume volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178 (23a5f5cd-d41b-4f28-b809-4ff213b1c178): created successfully Nov 03 13:28:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (504d6213-eea0-4476-accd-41373c0a6254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] Flow 'volume_create_manager' (e10a6d78-b802-4a12-9242-367178c18336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:47 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-5ad05e7b-1f8c-44be-9c62-7b4508465d1c tempest-ProjectReaderTests-2033320378 None] Created volume successfully. Nov 03 13:28:47 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59.87cb4afd-4be5-43fd-91e7-5d8096325311 Nov 03 13:28:47 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:47 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4fc8f853-ebf0-4ac8-a2d7-6139685f9222 tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59.87cb4afd-4be5-43fd-91e7-5d8096325311" returned: 0 in 0.416s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:47 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-4fc8f853-ebf0-4ac8-a2d7-6139685f9222 tempest-ProjectMemberTests-1676407320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:28:47 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[270bad2d-5c29-4f83-b9e8-cc814536d1a5]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4fc8f853-ebf0-4ac8-a2d7-6139685f9222 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:47 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:28:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] Flow 'volume_create_manager' (0a873974-4430-4022-9634-103cf24f63d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d84b6ed-7704-4a36-bbca-9b6e420d7e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:47 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59 Nov 03 13:28:47 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d84b6ed-7704-4a36-bbca-9b6e420d7e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1150150345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37b459fb-ec75-4c95-b6f7-36f52f06ee71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b68465c3b3424e3688ff1e6d8d17879a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:47Z,use_quota=True,user_id='033a1b3f19b24bf88065e5f9bece4154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dae7f46-5577-4c6c-a07f-31c88f8f0cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dae7f46-5577-4c6c-a07f-31c88f8f0cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d57b402a-fac5-4c00-8564-55493703f8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d57b402a-fac5-4c00-8564-55493703f8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37b459fb-ec75-4c95-b6f7-36f52f06ee71', 'volume_name': 'volume-37b459fb-ec75-4c95-b6f7-36f52f06ee71', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d05bbc17-3425-42b4-830d-95480ad44044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d05bbc17-3425-42b4-830d-95480ad44044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:47 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (876825ee-fdb1-470e-bf9f-5a3e64e3daff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:47 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] Volume 37b459fb-ec75-4c95-b6f7-36f52f06ee71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37b459fb-ec75-4c95-b6f7-36f52f06ee71', 'volume_size': 1} Nov 03 13:28:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:47 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1150150345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37b459fb-ec75-4c95-b6f7-36f52f06ee71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b68465c3b3424e3688ff1e6d8d17879a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:47Z,use_quota=True,user_id='033a1b3f19b24bf88065e5f9bece4154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:28:47 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] Creating volume 37b459fb-ec75-4c95-b6f7-36f52f06ee71 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:28:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:47 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:47 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:47 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:28:47 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:28:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-37b459fb-ec75-4c95-b6f7-36f52f06ee71 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:47 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-37b459fb-ec75-4c95-b6f7-36f52f06ee71 1073741824 Nov 03 13:28:47 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:47 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4fc8f853-ebf0-4ac8-a2d7-6139685f9222 tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59" returned: 0 in 0.448s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:47 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4fc8f853-ebf0-4ac8-a2d7-6139685f9222 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59.87cb4afd-4be5-43fd-91e7-5d8096325311 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:47 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59.87cb4afd-4be5-43fd-91e7-5d8096325311 Nov 03 13:28:47 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-dc8ddd99-1246-4ae7-bb6d-7fc112ceaf68 tempest-ProjectReaderTests-2033320378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:48 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-37b459fb-ec75-4c95-b6f7-36f52f06ee71 1073741824" returned: 0 in 0.559s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-37b459fb-ec75-4c95-b6f7-36f52f06ee71 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:48 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-37b459fb-ec75-4c95-b6f7-36f52f06ee71 Nov 03 13:28:48 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:48 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4fc8f853-ebf0-4ac8-a2d7-6139685f9222 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59.87cb4afd-4be5-43fd-91e7-5d8096325311" returned: 0 in 0.484s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4fc8f853-ebf0-4ac8-a2d7-6139685f9222 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59.87cb4afd-4be5-43fd-91e7-5d8096325311 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:48 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59.87cb4afd-4be5-43fd-91e7-5d8096325311 Nov 03 13:28:48 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:48 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-37b459fb-ec75-4c95-b6f7-36f52f06ee71" returned: 0 in 0.290s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:48 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:28:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-dc8ddd99-1246-4ae7-bb6d-7fc112ceaf68 tempest-ProjectReaderTests-2033320378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.350s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:48 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (876825ee-fdb1-470e-bf9f-5a3e64e3daff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37b459fb-ec75-4c95-b6f7-36f52f06ee71', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:48 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c55306e0-bd8f-439e-9fd4-67f3457f8572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:48 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-dc8ddd99-1246-4ae7-bb6d-7fc112ceaf68 tempest-ProjectReaderTests-2033320378 None] Creating offline snapshot 4675a46a-bcd9-467b-a998-85e2a90fbf68 of volume 23a5f5cd-d41b-4f28-b809-4ff213b1c178 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:28:48 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] Volume volume-37b459fb-ec75-4c95-b6f7-36f52f06ee71 (37b459fb-ec75-4c95-b6f7-36f52f06ee71): created successfully Nov 03 13:28:48 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c55306e0-bd8f-439e-9fd4-67f3457f8572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:48 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] Flow 'volume_create_manager' (0a873974-4430-4022-9634-103cf24f63d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:48 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f62e1bc-a84a-4133-bca3-6df7408a50ab]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-dc8ddd99-1246-4ae7-bb6d-7fc112ceaf68 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:48 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-40ffde08-41ea-4f08-b6de-3cfe0d61e222 tempest-ProjectReaderTests-170251636 None] Created volume successfully. Nov 03 13:28:48 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4fc8f853-ebf0-4ac8-a2d7-6139685f9222 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59.87cb4afd-4be5-43fd-91e7-5d8096325311" returned: 0 in 0.322s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:48 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4fc8f853-ebf0-4ac8-a2d7-6139685f9222 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-87cb4afd-4be5-43fd-91e7-5d8096325311" released by "_delete_snapshot" :: held 1.782s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:48 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178 Nov 03 13:28:48 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:48 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4fc8f853-ebf0-4ac8-a2d7-6139685f9222 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-f5c7d4f5-701d-403c-93b7-446dc4f4cc59" released by "delete_snapshot" :: held 1.809s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:48 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-4fc8f853-ebf0-4ac8-a2d7-6139685f9222 tempest-ProjectMemberTests-1676407320 None] Created reservations ['afd6e02c-7aba-4529-b608-1a3fd3779611', '5ed1b8bf-bc92-492b-8135-7d41103b2267', 'e31be0de-add6-4d66-b698-ef920cc46641', 'c352d207-df7b-430f-96c9-168fda2e3296'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:48 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-4fc8f853-ebf0-4ac8-a2d7-6139685f9222 tempest-ProjectMemberTests-1676407320 None] Delete snapshot completed successfully. Nov 03 13:28:48 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4fc8f853-ebf0-4ac8-a2d7-6139685f9222 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-87cb4afd-4be5-43fd-91e7-5d8096325311-delete_snapshot" released by "delete_snapshot" :: held 1.973s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:48 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-dc8ddd99-1246-4ae7-bb6d-7fc112ceaf68 tempest-ProjectReaderTests-2033320378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178" returned: 0 in 0.412s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:48 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-dc8ddd99-1246-4ae7-bb6d-7fc112ceaf68 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178.4675a46a-bcd9-467b-a998-85e2a90fbf68 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:49 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178.4675a46a-bcd9-467b-a998-85e2a90fbf68 1G Nov 03 13:28:49 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:49 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-070eea8a-43a9-4d89-9f4b-40cafac17fe1 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-f5c7d4f5-701d-403c-93b7-446dc4f4cc59-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:49 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-070eea8a-43a9-4d89-9f4b-40cafac17fe1 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-f5c7d4f5-701d-403c-93b7-446dc4f4cc59-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:49 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-070eea8a-43a9-4d89-9f4b-40cafac17fe1 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-quobyte-f5c7d4f5-701d-403c-93b7-446dc4f4cc59" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:49 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-070eea8a-43a9-4d89-9f4b-40cafac17fe1 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-f5c7d4f5-701d-403c-93b7-446dc4f4cc59" acquired by "delete_volume" :: waited 0.027s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:49 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da4a2e5-66ad-4d3e-a4cc-d6e9b2bdfbf7]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-070eea8a-43a9-4d89-9f4b-40cafac17fe1 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:49 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59 Nov 03 13:28:49 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:49 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-dc8ddd99-1246-4ae7-bb6d-7fc112ceaf68 tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178.4675a46a-bcd9-467b-a998-85e2a90fbf68 1G" returned: 0 in 0.506s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-dc8ddd99-1246-4ae7-bb6d-7fc112ceaf68 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178.4675a46a-bcd9-467b-a998-85e2a90fbf68 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:49 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178.4675a46a-bcd9-467b-a998-85e2a90fbf68 Nov 03 13:28:49 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:49 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-070eea8a-43a9-4d89-9f4b-40cafac17fe1 tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59" returned: 0 in 0.400s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-070eea8a-43a9-4d89-9f4b-40cafac17fe1 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:49 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59 Nov 03 13:28:49 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:49 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-dc8ddd99-1246-4ae7-bb6d-7fc112ceaf68 tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178.4675a46a-bcd9-467b-a998-85e2a90fbf68" returned: 0 in 0.345s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:49 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-dc8ddd99-1246-4ae7-bb6d-7fc112ceaf68 tempest-ProjectReaderTests-2033320378 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178.4675a46a-bcd9-467b-a998-85e2a90fbf68 is being set with open permissions: ugo+rw Nov 03 13:28:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-dc8ddd99-1246-4ae7-bb6d-7fc112ceaf68 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178.4675a46a-bcd9-467b-a998-85e2a90fbf68 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:49 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178.4675a46a-bcd9-467b-a998-85e2a90fbf68 Nov 03 13:28:49 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:49 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:49 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-070eea8a-43a9-4d89-9f4b-40cafac17fe1 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-f5c7d4f5-701d-403c-93b7-446dc4f4cc59" returned: 0 in 0.275s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:49 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-070eea8a-43a9-4d89-9f4b-40cafac17fe1 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-f5c7d4f5-701d-403c-93b7-446dc4f4cc59" released by "delete_volume" :: held 0.759s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:49 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8a8d410f-2085-4cf8-8f91-673100180c72 tempest-ProjectReaderTests-170251636 None] Acquiring lock "cinder-37b459fb-ec75-4c95-b6f7-36f52f06ee71-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:49 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8a8d410f-2085-4cf8-8f91-673100180c72 tempest-ProjectReaderTests-170251636 None] Lock "cinder-37b459fb-ec75-4c95-b6f7-36f52f06ee71-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8a8d410f-2085-4cf8-8f91-673100180c72 tempest-ProjectReaderTests-170251636 None] Acquiring lock "cinder-quobyte-37b459fb-ec75-4c95-b6f7-36f52f06ee71" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-070eea8a-43a9-4d89-9f4b-40cafac17fe1 tempest-ProjectMemberTests-1676407320 None] Created reservations ['0c543871-d3f9-4aa9-aa1b-9648a041d8ae', 'e935454c-0a5f-46da-ae88-4482b4f4a25c', '37f04e16-4038-4625-9eac-27a0b42476a2', '8eb2b602-391f-40fc-94a1-7b5284bfefa1'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8a8d410f-2085-4cf8-8f91-673100180c72 tempest-ProjectReaderTests-170251636 None] Lock "cinder-quobyte-37b459fb-ec75-4c95-b6f7-36f52f06ee71" acquired by "delete_volume" :: waited 0.022s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[26dc725e-04b7-472b-b2aa-40fd2285d8cb]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8a8d410f-2085-4cf8-8f91-673100180c72 tempest-ProjectReaderTests-170251636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-37b459fb-ec75-4c95-b6f7-36f52f06ee71 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-070eea8a-43a9-4d89-9f4b-40cafac17fe1 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-070eea8a-43a9-4d89-9f4b-40cafac17fe1 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-070eea8a-43a9-4d89-9f4b-40cafac17fe1 tempest-ProjectMemberTests-1676407320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-070eea8a-43a9-4d89-9f4b-40cafac17fe1 tempest-ProjectMemberTests-1676407320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-070eea8a-43a9-4d89-9f4b-40cafac17fe1 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-070eea8a-43a9-4d89-9f4b-40cafac17fe1 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:50 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-dc8ddd99-1246-4ae7-bb6d-7fc112ceaf68 tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178.4675a46a-bcd9-467b-a998-85e2a90fbf68" returned: 0 in 0.294s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:50 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:28:50 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-dc8ddd99-1246-4ae7-bb6d-7fc112ceaf68 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:50 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-37b459fb-ec75-4c95-b6f7-36f52f06ee71 Nov 03 13:28:50 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:50 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178.info Nov 03 13:28:50 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:50 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-070eea8a-43a9-4d89-9f4b-40cafac17fe1 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.283s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-070eea8a-43a9-4d89-9f4b-40cafac17fe1 tempest-ProjectMemberTests-1676407320 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:28:50 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-070eea8a-43a9-4d89-9f4b-40cafac17fe1 tempest-ProjectMemberTests-1676407320 None] Deleted volume successfully. Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-070eea8a-43a9-4d89-9f4b-40cafac17fe1 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-f5c7d4f5-701d-403c-93b7-446dc4f4cc59-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:50 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8a8d410f-2085-4cf8-8f91-673100180c72 tempest-ProjectReaderTests-170251636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-37b459fb-ec75-4c95-b6f7-36f52f06ee71" returned: 0 in 0.440s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8a8d410f-2085-4cf8-8f91-673100180c72 tempest-ProjectReaderTests-170251636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-37b459fb-ec75-4c95-b6f7-36f52f06ee71 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:50 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-dc8ddd99-1246-4ae7-bb6d-7fc112ceaf68 tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178.info" returned: 0 in 0.332s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:50 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-dc8ddd99-1246-4ae7-bb6d-7fc112ceaf68 tempest-ProjectReaderTests-2033320378 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178.info is being set with open permissions: ugo+rw Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-dc8ddd99-1246-4ae7-bb6d-7fc112ceaf68 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:50 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-37b459fb-ec75-4c95-b6f7-36f52f06ee71 Nov 03 13:28:50 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:50 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178.info Nov 03 13:28:50 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:28:50 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:50 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] Flow 'volume_create_manager' (1edb4f07-5e4e-407c-bfd9-a4c43d41838d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94407e36-2263-4378-a53d-feb97ba49e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8a8d410f-2085-4cf8-8f91-673100180c72 tempest-ProjectReaderTests-170251636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-37b459fb-ec75-4c95-b6f7-36f52f06ee71" returned: 0 in 0.316s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-dc8ddd99-1246-4ae7-bb6d-7fc112ceaf68 tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178.info" returned: 0 in 0.303s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-dc8ddd99-1246-4ae7-bb6d-7fc112ceaf68 tempest-ProjectReaderTests-2033320378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.352s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94407e36-2263-4378-a53d-feb97ba49e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-327115480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb58d631-4de1-49bf-bb47-9efff22f8070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60ac3b296fa402ebc45563747540073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:51Z,use_quota=True,user_id='82e28082879940beb510c24ff3452f75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd7d9d5b-b4ee-4d3b-aacb-e389610151cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd7d9d5b-b4ee-4d3b-aacb-e389610151cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (331aefff-0f38-476a-8614-491b1421ec3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (331aefff-0f38-476a-8614-491b1421ec3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb58d631-4de1-49bf-bb47-9efff22f8070', 'volume_name': 'volume-bb58d631-4de1-49bf-bb47-9efff22f8070', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fbb9a75-a416-4290-b8e6-da164ef0db27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fbb9a75-a416-4290-b8e6-da164ef0db27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (127e63c1-e696-46a8-8bf5-b610eb350f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:50 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] Volume bb58d631-4de1-49bf-bb47-9efff22f8070: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb58d631-4de1-49bf-bb47-9efff22f8070', 'volume_size': 1} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-327115480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb58d631-4de1-49bf-bb47-9efff22f8070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60ac3b296fa402ebc45563747540073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:51Z,use_quota=True,user_id='82e28082879940beb510c24ff3452f75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] Creating volume bb58d631-4de1-49bf-bb47-9efff22f8070 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:28:50 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8a8d410f-2085-4cf8-8f91-673100180c72 tempest-ProjectReaderTests-170251636 None] Lock "cinder-quobyte-37b459fb-ec75-4c95-b6f7-36f52f06ee71" released by "delete_volume" :: held 0.881s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:50 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070 1073741824 Nov 03 13:28:50 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:50 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-dc8ddd99-1246-4ae7-bb6d-7fc112ceaf68 tempest-ProjectReaderTests-2033320378 None] Create snapshot completed successfully Nov 03 13:28:50 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-8a8d410f-2085-4cf8-8f91-673100180c72 tempest-ProjectReaderTests-170251636 None] Created reservations ['e2d23eec-95a8-4618-8b30-e33d2cceebe6', 'e897357b-5af2-450e-9176-05a278c82b6e', '4677af26-339b-4406-bf78-7672dc1a5d6d', 'e50156c4-b8b9-45fb-9bcf-76b6f4643c63'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8a8d410f-2085-4cf8-8f91-673100180c72 tempest-ProjectReaderTests-170251636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8a8d410f-2085-4cf8-8f91-673100180c72 tempest-ProjectReaderTests-170251636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-8a8d410f-2085-4cf8-8f91-673100180c72 tempest-ProjectReaderTests-170251636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-8a8d410f-2085-4cf8-8f91-673100180c72 tempest-ProjectReaderTests-170251636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8a8d410f-2085-4cf8-8f91-673100180c72 tempest-ProjectReaderTests-170251636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8a8d410f-2085-4cf8-8f91-673100180c72 tempest-ProjectReaderTests-170251636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:51 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:28:51 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:51 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8a8d410f-2085-4cf8-8f91-673100180c72 tempest-ProjectReaderTests-170251636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.286s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-8a8d410f-2085-4cf8-8f91-673100180c72 tempest-ProjectReaderTests-170251636 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e04c115a-4d87-4a03-aab4-a1500c4fea23 tempest-ProjectReaderTests-2033320378 None] Acquiring lock "cinder-4675a46a-bcd9-467b-a998-85e2a90fbf68-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:51 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-8a8d410f-2085-4cf8-8f91-673100180c72 tempest-ProjectReaderTests-170251636 None] Deleted volume successfully. Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e04c115a-4d87-4a03-aab4-a1500c4fea23 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-4675a46a-bcd9-467b-a998-85e2a90fbf68-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e04c115a-4d87-4a03-aab4-a1500c4fea23 tempest-ProjectReaderTests-2033320378 None] Acquiring lock "cinder-quobyte-23a5f5cd-d41b-4f28-b809-4ff213b1c178" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8a8d410f-2085-4cf8-8f91-673100180c72 tempest-ProjectReaderTests-170251636 None] Lock "cinder-37b459fb-ec75-4c95-b6f7-36f52f06ee71-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e04c115a-4d87-4a03-aab4-a1500c4fea23 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-quobyte-23a5f5cd-d41b-4f28-b809-4ff213b1c178" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e04c115a-4d87-4a03-aab4-a1500c4fea23 tempest-ProjectReaderTests-2033320378 None] Acquiring lock "cinder-quobyte-4675a46a-bcd9-467b-a998-85e2a90fbf68" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e04c115a-4d87-4a03-aab4-a1500c4fea23 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-quobyte-4675a46a-bcd9-467b-a998-85e2a90fbf68" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-e04c115a-4d87-4a03-aab4-a1500c4fea23 tempest-ProjectReaderTests-2033320378 None] Deleting offline snapshot 4675a46a-bcd9-467b-a998-85e2a90fbf68 of volume 23a5f5cd-d41b-4f28-b809-4ff213b1c178 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:28:51 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-e04c115a-4d87-4a03-aab4-a1500c4fea23 tempest-ProjectReaderTests-2033320378 None] snapshot_file for this snap is: volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178.4675a46a-bcd9-467b-a998-85e2a90fbf68 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070 1073741824" returned: 0 in 0.598s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48efe3a-8688-4e9d-9940-a971be669920]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e04c115a-4d87-4a03-aab4-a1500c4fea23 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178.4675a46a-bcd9-467b-a998-85e2a90fbf68 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:51 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070 Nov 03 13:28:51 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:51 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178.4675a46a-bcd9-467b-a998-85e2a90fbf68 Nov 03 13:28:51 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] Flow 'volume_create_manager' (658062ea-67c6-40dc-9a0c-12ef0c93b991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c076787-b264-4f96-a6d2-c932e74525a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c076787-b264-4f96-a6d2-c932e74525a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-147265381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcac9aeb-191e-4956-8519-0f12eed7d9a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b68465c3b3424e3688ff1e6d8d17879a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:52Z,use_quota=True,user_id='033a1b3f19b24bf88065e5f9bece4154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235df71c-5de4-4318-b086-27d39e40b871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235df71c-5de4-4318-b086-27d39e40b871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d16e15b7-0de5-4433-a5fd-7a4b40f05762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d16e15b7-0de5-4433-a5fd-7a4b40f05762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcac9aeb-191e-4956-8519-0f12eed7d9a2', 'volume_name': 'volume-bcac9aeb-191e-4956-8519-0f12eed7d9a2', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdaf8ca1-a46c-4522-a1af-c9f00c7a5370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdaf8ca1-a46c-4522-a1af-c9f00c7a5370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8f7d6e-71f9-4218-b161-046b9d647899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:51 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] Volume bcac9aeb-191e-4956-8519-0f12eed7d9a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcac9aeb-191e-4956-8519-0f12eed7d9a2', 'volume_size': 1} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:51 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070" returned: 0 in 0.283s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.056s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-147265381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcac9aeb-191e-4956-8519-0f12eed7d9a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b68465c3b3424e3688ff1e6d8d17879a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:52Z,use_quota=True,user_id='033a1b3f19b24bf88065e5f9bece4154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] Creating volume bcac9aeb-191e-4956-8519-0f12eed7d9a2 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:28:51 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bcac9aeb-191e-4956-8519-0f12eed7d9a2 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (127e63c1-e696-46a8-8bf5-b610eb350f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb58d631-4de1-49bf-bb47-9efff22f8070', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3deeaad-04bf-45e3-b4e7-a212e5cd5842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:51 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bcac9aeb-191e-4956-8519-0f12eed7d9a2 1073741824 Nov 03 13:28:51 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:51 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] Volume volume-bb58d631-4de1-49bf-bb47-9efff22f8070 (bb58d631-4de1-49bf-bb47-9efff22f8070): created successfully Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3deeaad-04bf-45e3-b4e7-a212e5cd5842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:51 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] Flow 'volume_create_manager' (1edb4f07-5e4e-407c-bfd9-a4c43d41838d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e04c115a-4d87-4a03-aab4-a1500c4fea23 tempest-ProjectReaderTests-2033320378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178.4675a46a-bcd9-467b-a998-85e2a90fbf68" returned: 0 in 0.405s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-e04c115a-4d87-4a03-aab4-a1500c4fea23 tempest-ProjectReaderTests-2033320378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:28:51 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-5e204d02-98f6-4498-8c1a-a1f45d506e3e tempest-ProjectMemberTests-1676407320 None] Created volume successfully. Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f2a963-523e-409b-8458-bf8bf0e3a2ca]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:51 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e04c115a-4d87-4a03-aab4-a1500c4fea23 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:52 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178 Nov 03 13:28:52 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:52 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bcac9aeb-191e-4956-8519-0f12eed7d9a2 1073741824" returned: 0 in 0.455s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bcac9aeb-191e-4956-8519-0f12eed7d9a2 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:52 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e04c115a-4d87-4a03-aab4-a1500c4fea23 tempest-ProjectReaderTests-2033320378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178" returned: 0 in 0.415s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e04c115a-4d87-4a03-aab4-a1500c4fea23 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178.4675a46a-bcd9-467b-a998-85e2a90fbf68 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:52 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bcac9aeb-191e-4956-8519-0f12eed7d9a2 Nov 03 13:28:52 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:52 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178.4675a46a-bcd9-467b-a998-85e2a90fbf68 Nov 03 13:28:52 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:52 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bcac9aeb-191e-4956-8519-0f12eed7d9a2" returned: 0 in 0.275s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:52 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:28:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8f7d6e-71f9-4218-b161-046b9d647899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcac9aeb-191e-4956-8519-0f12eed7d9a2', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69651d11-795c-4f07-89ce-3f9f834ba5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:52 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] Volume volume-bcac9aeb-191e-4956-8519-0f12eed7d9a2 (bcac9aeb-191e-4956-8519-0f12eed7d9a2): created successfully Nov 03 13:28:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69651d11-795c-4f07-89ce-3f9f834ba5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:52 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] Flow 'volume_create_manager' (658062ea-67c6-40dc-9a0c-12ef0c93b991) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:52 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-7b9cb3d3-2bdb-4d9a-8151-f520e497ce89 tempest-ProjectReaderTests-170251636 None] Created volume successfully. Nov 03 13:28:52 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e04c115a-4d87-4a03-aab4-a1500c4fea23 tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178.4675a46a-bcd9-467b-a998-85e2a90fbf68" returned: 0 in 0.368s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e04c115a-4d87-4a03-aab4-a1500c4fea23 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178.4675a46a-bcd9-467b-a998-85e2a90fbf68 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:52 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178.4675a46a-bcd9-467b-a998-85e2a90fbf68 Nov 03 13:28:52 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:52 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:52 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e04c115a-4d87-4a03-aab4-a1500c4fea23 tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178.4675a46a-bcd9-467b-a998-85e2a90fbf68" returned: 0 in 0.273s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e04c115a-4d87-4a03-aab4-a1500c4fea23 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-quobyte-4675a46a-bcd9-467b-a998-85e2a90fbf68" released by "_delete_snapshot" :: held 1.577s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5b8e78b2-4b47-4c8c-8f50-8f763c9350f1 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5b8e78b2-4b47-4c8c-8f50-8f763c9350f1 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e04c115a-4d87-4a03-aab4-a1500c4fea23 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-quobyte-23a5f5cd-d41b-4f28-b809-4ff213b1c178" released by "delete_snapshot" :: held 1.605s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:53 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-5b8e78b2-4b47-4c8c-8f50-8f763c9350f1 tempest-ProjectMemberTests-1676407320 None] Creating offline snapshot 14eb21da-a859-4579-9452-56d777e3c300 of volume bb58d631-4de1-49bf-bb47-9efff22f8070 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:28:53 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65ac106-9448-4458-ad31-d4f796f348e1]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5b8e78b2-4b47-4c8c-8f50-8f763c9350f1 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:53 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-e04c115a-4d87-4a03-aab4-a1500c4fea23 tempest-ProjectReaderTests-2033320378 None] Created reservations ['2f56eecf-d3ad-4398-8111-7c2f52879aa9', '3c3c23a1-e00b-4a26-834e-1c5949a6dcd8', '4a23c072-ca50-48cf-a68d-b733ba5fcd95', '4b74c5bf-64b8-44fe-8375-17c132886fc2'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:53 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-e04c115a-4d87-4a03-aab4-a1500c4fea23 tempest-ProjectReaderTests-2033320378 None] Delete snapshot completed successfully. Nov 03 13:28:53 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070 Nov 03 13:28:53 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e04c115a-4d87-4a03-aab4-a1500c4fea23 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-4675a46a-bcd9-467b-a998-85e2a90fbf68-delete_snapshot" released by "delete_snapshot" :: held 1.779s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:53 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5b8e78b2-4b47-4c8c-8f50-8f763c9350f1 tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070" returned: 0 in 0.363s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5b8e78b2-4b47-4c8c-8f50-8f763c9350f1 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070.14eb21da-a859-4579-9452-56d777e3c300 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:53 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070.14eb21da-a859-4579-9452-56d777e3c300 1G Nov 03 13:28:53 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-f42812b5-03cd-44ed-950d-3d44ace548c7 tempest-ProjectReaderTests-2033320378 None] Acquiring lock "cinder-23a5f5cd-d41b-4f28-b809-4ff213b1c178-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-f42812b5-03cd-44ed-950d-3d44ace548c7 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-23a5f5cd-d41b-4f28-b809-4ff213b1c178-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-f42812b5-03cd-44ed-950d-3d44ace548c7 tempest-ProjectReaderTests-2033320378 None] Acquiring lock "cinder-quobyte-23a5f5cd-d41b-4f28-b809-4ff213b1c178" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-f42812b5-03cd-44ed-950d-3d44ace548c7 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-quobyte-23a5f5cd-d41b-4f28-b809-4ff213b1c178" acquired by "delete_volume" :: waited 0.017s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:53 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[3165bf4a-419c-43c1-8b4a-c030e705fab1]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f42812b5-03cd-44ed-950d-3d44ace548c7 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:53 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178 Nov 03 13:28:53 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-2bf82a05-2a87-4c45-92bb-0150dcc5f116 tempest-ProjectReaderTests-170251636 None] Acquiring lock "cinder-bcac9aeb-191e-4956-8519-0f12eed7d9a2-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-2bf82a05-2a87-4c45-92bb-0150dcc5f116 tempest-ProjectReaderTests-170251636 None] Lock "cinder-bcac9aeb-191e-4956-8519-0f12eed7d9a2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-2bf82a05-2a87-4c45-92bb-0150dcc5f116 tempest-ProjectReaderTests-170251636 None] Acquiring lock "cinder-quobyte-bcac9aeb-191e-4956-8519-0f12eed7d9a2" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:53 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5b8e78b2-4b47-4c8c-8f50-8f763c9350f1 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070.14eb21da-a859-4579-9452-56d777e3c300 1G" returned: 0 in 0.498s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5b8e78b2-4b47-4c8c-8f50-8f763c9350f1 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb58d631-4de1-49bf-bb47-9efff22f8070 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070.14eb21da-a859-4579-9452-56d777e3c300 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:53 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-2bf82a05-2a87-4c45-92bb-0150dcc5f116 tempest-ProjectReaderTests-170251636 None] Lock "cinder-quobyte-bcac9aeb-191e-4956-8519-0f12eed7d9a2" acquired by "delete_volume" :: waited 0.028s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:53 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb58d631-4de1-49bf-bb47-9efff22f8070 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070.14eb21da-a859-4579-9452-56d777e3c300 Nov 03 13:28:53 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:53 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[1823eed6-5ea8-423d-adec-12803e6bb552]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:53 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2bf82a05-2a87-4c45-92bb-0150dcc5f116 tempest-ProjectReaderTests-170251636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bcac9aeb-191e-4956-8519-0f12eed7d9a2 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:54 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bcac9aeb-191e-4956-8519-0f12eed7d9a2 Nov 03 13:28:54 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:54 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f42812b5-03cd-44ed-950d-3d44ace548c7 tempest-ProjectReaderTests-2033320378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178" returned: 0 in 0.480s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f42812b5-03cd-44ed-950d-3d44ace548c7 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:54 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178 Nov 03 13:28:54 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:54 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5b8e78b2-4b47-4c8c-8f50-8f763c9350f1 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb58d631-4de1-49bf-bb47-9efff22f8070 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070.14eb21da-a859-4579-9452-56d777e3c300" returned: 0 in 0.319s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:54 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-5b8e78b2-4b47-4c8c-8f50-8f763c9350f1 tempest-ProjectMemberTests-1676407320 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070.14eb21da-a859-4579-9452-56d777e3c300 is being set with open permissions: ugo+rw Nov 03 13:28:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5b8e78b2-4b47-4c8c-8f50-8f763c9350f1 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070.14eb21da-a859-4579-9452-56d777e3c300 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:54 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070.14eb21da-a859-4579-9452-56d777e3c300 Nov 03 13:28:54 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:54 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2bf82a05-2a87-4c45-92bb-0150dcc5f116 tempest-ProjectReaderTests-170251636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bcac9aeb-191e-4956-8519-0f12eed7d9a2" returned: 0 in 0.416s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2bf82a05-2a87-4c45-92bb-0150dcc5f116 tempest-ProjectReaderTests-170251636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bcac9aeb-191e-4956-8519-0f12eed7d9a2 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:54 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bcac9aeb-191e-4956-8519-0f12eed7d9a2 Nov 03 13:28:54 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:54 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f42812b5-03cd-44ed-950d-3d44ace548c7 tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-23a5f5cd-d41b-4f28-b809-4ff213b1c178" returned: 0 in 0.260s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:54 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-f42812b5-03cd-44ed-950d-3d44ace548c7 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-quobyte-23a5f5cd-d41b-4f28-b809-4ff213b1c178" released by "delete_volume" :: held 0.820s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:54 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:54 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-f42812b5-03cd-44ed-950d-3d44ace548c7 tempest-ProjectReaderTests-2033320378 None] Created reservations ['029e5aca-abe5-49b6-8dc5-aca8487cd71b', '0e0cf081-e3be-45af-9122-31c87736f2ab', '87a9881f-98a1-4bc3-9543-e1c7c9dcce5b', '3b731b6a-3f08-4741-b3a7-21ab0aaad065'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5b8e78b2-4b47-4c8c-8f50-8f763c9350f1 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070.14eb21da-a859-4579-9452-56d777e3c300" returned: 0 in 0.267s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5b8e78b2-4b47-4c8c-8f50-8f763c9350f1 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:54 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070.info Nov 03 13:28:54 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f42812b5-03cd-44ed-950d-3d44ace548c7 tempest-ProjectReaderTests-2033320378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f42812b5-03cd-44ed-950d-3d44ace548c7 tempest-ProjectReaderTests-2033320378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:54 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f42812b5-03cd-44ed-950d-3d44ace548c7 tempest-ProjectReaderTests-2033320378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:54 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-f42812b5-03cd-44ed-950d-3d44ace548c7 tempest-ProjectReaderTests-2033320378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f42812b5-03cd-44ed-950d-3d44ace548c7 tempest-ProjectReaderTests-2033320378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f42812b5-03cd-44ed-950d-3d44ace548c7 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:54 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:28:54 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:54 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2bf82a05-2a87-4c45-92bb-0150dcc5f116 tempest-ProjectReaderTests-170251636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bcac9aeb-191e-4956-8519-0f12eed7d9a2" returned: 0 in 0.284s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:54 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-2bf82a05-2a87-4c45-92bb-0150dcc5f116 tempest-ProjectReaderTests-170251636 None] Lock "cinder-quobyte-bcac9aeb-191e-4956-8519-0f12eed7d9a2" released by "delete_volume" :: held 0.765s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:54 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-2bf82a05-2a87-4c45-92bb-0150dcc5f116 tempest-ProjectReaderTests-170251636 None] Created reservations ['ef90638a-372f-41ad-89f7-62990da43b50', '28cea993-f02b-4531-a7cf-8fc6459320d7', 'f308a631-b321-4eea-ab2d-87d96102fd03', 'a39b8b71-73d8-4ecf-b7f3-a0d078e75422'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2bf82a05-2a87-4c45-92bb-0150dcc5f116 tempest-ProjectReaderTests-170251636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2bf82a05-2a87-4c45-92bb-0150dcc5f116 tempest-ProjectReaderTests-170251636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:54 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2bf82a05-2a87-4c45-92bb-0150dcc5f116 tempest-ProjectReaderTests-170251636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:54 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2bf82a05-2a87-4c45-92bb-0150dcc5f116 tempest-ProjectReaderTests-170251636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2bf82a05-2a87-4c45-92bb-0150dcc5f116 tempest-ProjectReaderTests-170251636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2bf82a05-2a87-4c45-92bb-0150dcc5f116 tempest-ProjectReaderTests-170251636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:54 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5b8e78b2-4b47-4c8c-8f50-8f763c9350f1 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070.info" returned: 0 in 0.324s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:54 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-5b8e78b2-4b47-4c8c-8f50-8f763c9350f1 tempest-ProjectMemberTests-1676407320 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070.info is being set with open permissions: ugo+rw Nov 03 13:28:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5b8e78b2-4b47-4c8c-8f50-8f763c9350f1 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:54 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:28:54 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:54 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:54 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f42812b5-03cd-44ed-950d-3d44ace548c7 tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.291s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:54 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-f42812b5-03cd-44ed-950d-3d44ace548c7 tempest-ProjectReaderTests-2033320378 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:28:54 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070.info Nov 03 13:28:54 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:54 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-f42812b5-03cd-44ed-950d-3d44ace548c7 tempest-ProjectReaderTests-2033320378 None] Deleted volume successfully. Nov 03 13:28:54 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-f42812b5-03cd-44ed-950d-3d44ace548c7 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-23a5f5cd-d41b-4f28-b809-4ff213b1c178-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:55 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2bf82a05-2a87-4c45-92bb-0150dcc5f116 tempest-ProjectReaderTests-170251636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.337s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-2bf82a05-2a87-4c45-92bb-0150dcc5f116 tempest-ProjectReaderTests-170251636 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:28:55 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-2bf82a05-2a87-4c45-92bb-0150dcc5f116 tempest-ProjectReaderTests-170251636 None] Deleted volume successfully. Nov 03 13:28:55 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5b8e78b2-4b47-4c8c-8f50-8f763c9350f1 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070.info" returned: 0 in 0.338s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5b8e78b2-4b47-4c8c-8f50-8f763c9350f1 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.206s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-2bf82a05-2a87-4c45-92bb-0150dcc5f116 tempest-ProjectReaderTests-170251636 None] Lock "cinder-bcac9aeb-191e-4956-8519-0f12eed7d9a2-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:55 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-5b8e78b2-4b47-4c8c-8f50-8f763c9350f1 tempest-ProjectMemberTests-1676407320 None] Create snapshot completed successfully Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] Flow 'volume_create_manager' (88b80b54-bd08-4bed-91fc-1343badb22f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b3f1b75-287f-469a-a914-fcf8064c576a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b3f1b75-287f-469a-a914-fcf8064c576a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1147183040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=938f1b5f-7b9e-4b43-b7aa-9261f71f26c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d44080166948cea704fa07a936c807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:55Z,use_quota=True,user_id='eaeace3300d748f19b758c594a4c4ee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28605299-8941-4b10-bb09-6882d762d234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28605299-8941-4b10-bb09-6882d762d234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed56e6d-272c-4197-a0b0-101a1f57ed7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed56e6d-272c-4197-a0b0-101a1f57ed7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '938f1b5f-7b9e-4b43-b7aa-9261f71f26c9', 'volume_name': 'volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3076846e-0121-4632-a69a-ac7379b886ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3076846e-0121-4632-a69a-ac7379b886ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdc2cc57-163f-4d4d-b62a-f9742373a717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:55 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] Volume 938f1b5f-7b9e-4b43-b7aa-9261f71f26c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9', 'volume_size': 1} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1147183040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=938f1b5f-7b9e-4b43-b7aa-9261f71f26c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d44080166948cea704fa07a936c807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:55Z,use_quota=True,user_id='eaeace3300d748f19b758c594a4c4ee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] Creating volume 938f1b5f-7b9e-4b43-b7aa-9261f71f26c9 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:28:55 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:55 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9 1073741824 Nov 03 13:28:55 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] Flow 'volume_create_manager' (9bb8e921-9c16-46fe-9839-667c4bcf2ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7f609f0-5141-4ed2-9c2b-5a6915fd1ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7f609f0-5141-4ed2-9c2b-5a6915fd1ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-314266185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3cb9d85-0d1e-49f8-bd6b-fcbb962e5978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b68465c3b3424e3688ff1e6d8d17879a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:56Z,use_quota=True,user_id='033a1b3f19b24bf88065e5f9bece4154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c42f173d-5fc7-46ce-b6e5-2914fb529edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c42f173d-5fc7-46ce-b6e5-2914fb529edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff5d32f9-f15f-440a-be88-d4af0c5ede99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff5d32f9-f15f-440a-be88-d4af0c5ede99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3cb9d85-0d1e-49f8-bd6b-fcbb962e5978', 'volume_name': 'volume-b3cb9d85-0d1e-49f8-bd6b-fcbb962e5978', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a6a11ac-23bc-4b45-8ee7-22d6d19c43fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a6a11ac-23bc-4b45-8ee7-22d6d19c43fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9224ee1-1f2c-45b5-8d6a-e9288f8ae72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:55 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] Volume b3cb9d85-0d1e-49f8-bd6b-fcbb962e5978: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3cb9d85-0d1e-49f8-bd6b-fcbb962e5978', 'volume_size': 1} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:55 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9 1073741824" returned: 0 in 0.419s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:55 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:55 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9 Nov 03 13:28:55 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:56 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9" returned: 0 in 0.253s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.498s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-314266185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3cb9d85-0d1e-49f8-bd6b-fcbb962e5978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b68465c3b3424e3688ff1e6d8d17879a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:56Z,use_quota=True,user_id='033a1b3f19b24bf88065e5f9bece4154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] Creating volume b3cb9d85-0d1e-49f8-bd6b-fcbb962e5978 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:28:56 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3cb9d85-0d1e-49f8-bd6b-fcbb962e5978 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdc2cc57-163f-4d4d-b62a-f9742373a717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:56 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3cb9d85-0d1e-49f8-bd6b-fcbb962e5978 1073741824 Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2106231a-25e4-48bf-890b-f6b04b31d584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:56 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:56 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] Volume volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9 (938f1b5f-7b9e-4b43-b7aa-9261f71f26c9): created successfully Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2106231a-25e4-48bf-890b-f6b04b31d584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] Flow 'volume_create_manager' (88b80b54-bd08-4bed-91fc-1343badb22f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c49d5de9-c141-4b0e-96d1-91433f5eab43 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-14eb21da-a859-4579-9452-56d777e3c300-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:56 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-cff1a6d7-e94f-4044-bf28-d23a2440cae0 tempest-ProjectReaderTests-2033320378 None] Created volume successfully. Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c49d5de9-c141-4b0e-96d1-91433f5eab43 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-14eb21da-a859-4579-9452-56d777e3c300-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c49d5de9-c141-4b0e-96d1-91433f5eab43 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-quobyte-bb58d631-4de1-49bf-bb47-9efff22f8070" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c49d5de9-c141-4b0e-96d1-91433f5eab43 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-bb58d631-4de1-49bf-bb47-9efff22f8070" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c49d5de9-c141-4b0e-96d1-91433f5eab43 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-quobyte-14eb21da-a859-4579-9452-56d777e3c300" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c49d5de9-c141-4b0e-96d1-91433f5eab43 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-14eb21da-a859-4579-9452-56d777e3c300" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-c49d5de9-c141-4b0e-96d1-91433f5eab43 tempest-ProjectMemberTests-1676407320 None] Deleting offline snapshot 14eb21da-a859-4579-9452-56d777e3c300 of volume bb58d631-4de1-49bf-bb47-9efff22f8070 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-c49d5de9-c141-4b0e-96d1-91433f5eab43 tempest-ProjectMemberTests-1676407320 None] snapshot_file for this snap is: volume-bb58d631-4de1-49bf-bb47-9efff22f8070.14eb21da-a859-4579-9452-56d777e3c300 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[33649f14-e084-489d-94ff-27a1c82b9ca5]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c49d5de9-c141-4b0e-96d1-91433f5eab43 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070.14eb21da-a859-4579-9452-56d777e3c300 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:56 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070.14eb21da-a859-4579-9452-56d777e3c300 Nov 03 13:28:56 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:56 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3cb9d85-0d1e-49f8-bd6b-fcbb962e5978 1073741824" returned: 0 in 0.483s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3cb9d85-0d1e-49f8-bd6b-fcbb962e5978 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:56 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3cb9d85-0d1e-49f8-bd6b-fcbb962e5978 Nov 03 13:28:56 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:56 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c49d5de9-c141-4b0e-96d1-91433f5eab43 tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070.14eb21da-a859-4579-9452-56d777e3c300" returned: 0 in 0.403s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-c49d5de9-c141-4b0e-96d1-91433f5eab43 tempest-ProjectMemberTests-1676407320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb58d631-4de1-49bf-bb47-9efff22f8070(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ba9521-b10a-46da-b3fe-14697c0a2635]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c49d5de9-c141-4b0e-96d1-91433f5eab43 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:56 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070 Nov 03 13:28:56 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:56 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3cb9d85-0d1e-49f8-bd6b-fcbb962e5978" returned: 0 in 0.258s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9224ee1-1f2c-45b5-8d6a-e9288f8ae72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3cb9d85-0d1e-49f8-bd6b-fcbb962e5978', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ea83df6-8992-497a-acbb-99fb468da9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:56 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] Volume volume-b3cb9d85-0d1e-49f8-bd6b-fcbb962e5978 (b3cb9d85-0d1e-49f8-bd6b-fcbb962e5978): created successfully Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ea83df6-8992-497a-acbb-99fb468da9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:56 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] Flow 'volume_create_manager' (9bb8e921-9c16-46fe-9839-667c4bcf2ec3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:57 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-0a2232a7-ed8d-4c12-8b32-d785cd1c1a20 tempest-ProjectReaderTests-170251636 None] Created volume successfully. Nov 03 13:28:57 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c49d5de9-c141-4b0e-96d1-91433f5eab43 tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070" returned: 0 in 0.371s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c49d5de9-c141-4b0e-96d1-91433f5eab43 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070.14eb21da-a859-4579-9452-56d777e3c300 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:57 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070.14eb21da-a859-4579-9452-56d777e3c300 Nov 03 13:28:57 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:57 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c49d5de9-c141-4b0e-96d1-91433f5eab43 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070.14eb21da-a859-4579-9452-56d777e3c300" returned: 0 in 0.377s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c49d5de9-c141-4b0e-96d1-91433f5eab43 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070.14eb21da-a859-4579-9452-56d777e3c300 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7ebd7ff1-79b9-46f7-a8e4-e60aa6d53c1a tempest-ProjectReaderTests-2033320378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7ebd7ff1-79b9-46f7-a8e4-e60aa6d53c1a tempest-ProjectReaderTests-2033320378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:57 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070.14eb21da-a859-4579-9452-56d777e3c300 Nov 03 13:28:57 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:57 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-7ebd7ff1-79b9-46f7-a8e4-e60aa6d53c1a tempest-ProjectReaderTests-2033320378 None] Creating offline snapshot 59737688-8c68-4907-b468-0456e21a1bdd of volume 938f1b5f-7b9e-4b43-b7aa-9261f71f26c9 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:28:57 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[5664a1ba-c101-4dd3-92e1-e19269704da0]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7ebd7ff1-79b9-46f7-a8e4-e60aa6d53c1a tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:57 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0550bf27-5c46-4460-a049-f745771f2477 tempest-ProjectReaderTests-170251636 None] Acquiring lock "cinder-b3cb9d85-0d1e-49f8-bd6b-fcbb962e5978-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:57 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9 Nov 03 13:28:57 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:57 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0550bf27-5c46-4460-a049-f745771f2477 tempest-ProjectReaderTests-170251636 None] Lock "cinder-b3cb9d85-0d1e-49f8-bd6b-fcbb962e5978-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:57 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0550bf27-5c46-4460-a049-f745771f2477 tempest-ProjectReaderTests-170251636 None] Acquiring lock "cinder-quobyte-b3cb9d85-0d1e-49f8-bd6b-fcbb962e5978" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:57 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0550bf27-5c46-4460-a049-f745771f2477 tempest-ProjectReaderTests-170251636 None] Lock "cinder-quobyte-b3cb9d85-0d1e-49f8-bd6b-fcbb962e5978" acquired by "delete_volume" :: waited 0.022s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:57 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:57 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[3502b1e1-ed77-4e8f-9dd7-9e76c0bfd9d5]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0550bf27-5c46-4460-a049-f745771f2477 tempest-ProjectReaderTests-170251636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3cb9d85-0d1e-49f8-bd6b-fcbb962e5978 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:57 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c49d5de9-c141-4b0e-96d1-91433f5eab43 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070.14eb21da-a859-4579-9452-56d777e3c300" returned: 0 in 0.331s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:57 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c49d5de9-c141-4b0e-96d1-91433f5eab43 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-14eb21da-a859-4579-9452-56d777e3c300" released by "_delete_snapshot" :: held 1.599s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:57 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c49d5de9-c141-4b0e-96d1-91433f5eab43 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-bb58d631-4de1-49bf-bb47-9efff22f8070" released by "delete_snapshot" :: held 1.624s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:58 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3cb9d85-0d1e-49f8-bd6b-fcbb962e5978 Nov 03 13:28:58 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:58 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-c49d5de9-c141-4b0e-96d1-91433f5eab43 tempest-ProjectMemberTests-1676407320 None] Created reservations ['0364bfa5-22e9-4073-a3dd-b08fc1b34563', '80942854-56a3-49a4-bb5c-ca1f1ac1c0ad', '8fe87f73-d480-474b-9aa7-46294c26eeee', 'd8099672-49aa-4c20-b4bd-e566938bf3f0'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:58 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7ebd7ff1-79b9-46f7-a8e4-e60aa6d53c1a tempest-ProjectReaderTests-2033320378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9" returned: 0 in 0.424s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7ebd7ff1-79b9-46f7-a8e4-e60aa6d53c1a tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9.59737688-8c68-4907-b468-0456e21a1bdd 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:58 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-c49d5de9-c141-4b0e-96d1-91433f5eab43 tempest-ProjectMemberTests-1676407320 None] Delete snapshot completed successfully. Nov 03 13:28:58 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9.59737688-8c68-4907-b468-0456e21a1bdd 1G Nov 03 13:28:58 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:58 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c49d5de9-c141-4b0e-96d1-91433f5eab43 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-14eb21da-a859-4579-9452-56d777e3c300-delete_snapshot" released by "delete_snapshot" :: held 1.801s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:58 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0550bf27-5c46-4460-a049-f745771f2477 tempest-ProjectReaderTests-170251636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3cb9d85-0d1e-49f8-bd6b-fcbb962e5978" returned: 0 in 0.398s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0550bf27-5c46-4460-a049-f745771f2477 tempest-ProjectReaderTests-170251636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3cb9d85-0d1e-49f8-bd6b-fcbb962e5978 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:58 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3cb9d85-0d1e-49f8-bd6b-fcbb962e5978 Nov 03 13:28:58 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:58 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3819c29c-9e8c-4f19-9388-7333e840a567 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-bb58d631-4de1-49bf-bb47-9efff22f8070-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:58 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3819c29c-9e8c-4f19-9388-7333e840a567 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-bb58d631-4de1-49bf-bb47-9efff22f8070-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:58 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7ebd7ff1-79b9-46f7-a8e4-e60aa6d53c1a tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9.59737688-8c68-4907-b468-0456e21a1bdd 1G" returned: 0 in 0.460s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7ebd7ff1-79b9-46f7-a8e4-e60aa6d53c1a tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9.59737688-8c68-4907-b468-0456e21a1bdd {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:58 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3819c29c-9e8c-4f19-9388-7333e840a567 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-quobyte-bb58d631-4de1-49bf-bb47-9efff22f8070" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:28:58 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9.59737688-8c68-4907-b468-0456e21a1bdd Nov 03 13:28:58 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:58 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3819c29c-9e8c-4f19-9388-7333e840a567 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-bb58d631-4de1-49bf-bb47-9efff22f8070" acquired by "delete_volume" :: waited 0.023s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:28:58 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0550bf27-5c46-4460-a049-f745771f2477 tempest-ProjectReaderTests-170251636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-b3cb9d85-0d1e-49f8-bd6b-fcbb962e5978" returned: 0 in 0.317s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:58 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0550bf27-5c46-4460-a049-f745771f2477 tempest-ProjectReaderTests-170251636 None] Lock "cinder-quobyte-b3cb9d85-0d1e-49f8-bd6b-fcbb962e5978" released by "delete_volume" :: held 0.761s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:58 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c6bde2-2b50-4cc6-a863-f59fc0bdfdee]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:28:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3819c29c-9e8c-4f19-9388-7333e840a567 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:58 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-0550bf27-5c46-4460-a049-f745771f2477 tempest-ProjectReaderTests-170251636 None] Created reservations ['b0841313-2778-4b65-8b34-db4a8b6d8b3c', 'f285f0e7-c3ef-4ecc-8183-fb328416a177', 'c26a34b7-649a-421a-9fe2-3cf97d55c1c3', '48cf1249-9c05-491f-9d39-71be59c0dcd9'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:58 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070 Nov 03 13:28:58 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0550bf27-5c46-4460-a049-f745771f2477 tempest-ProjectReaderTests-170251636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0550bf27-5c46-4460-a049-f745771f2477 tempest-ProjectReaderTests-170251636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0550bf27-5c46-4460-a049-f745771f2477 tempest-ProjectReaderTests-170251636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0550bf27-5c46-4460-a049-f745771f2477 tempest-ProjectReaderTests-170251636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0550bf27-5c46-4460-a049-f745771f2477 tempest-ProjectReaderTests-170251636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0550bf27-5c46-4460-a049-f745771f2477 tempest-ProjectReaderTests-170251636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:58 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:28:58 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:58 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:28:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:58 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7ebd7ff1-79b9-46f7-a8e4-e60aa6d53c1a tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9.59737688-8c68-4907-b468-0456e21a1bdd" returned: 0 in 0.341s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:58 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-7ebd7ff1-79b9-46f7-a8e4-e60aa6d53c1a tempest-ProjectReaderTests-2033320378 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9.59737688-8c68-4907-b468-0456e21a1bdd is being set with open permissions: ugo+rw Nov 03 13:28:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7ebd7ff1-79b9-46f7-a8e4-e60aa6d53c1a tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9.59737688-8c68-4907-b468-0456e21a1bdd {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:58 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:28:58 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:58 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9.59737688-8c68-4907-b468-0456e21a1bdd Nov 03 13:28:58 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:59 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0550bf27-5c46-4460-a049-f745771f2477 tempest-ProjectReaderTests-170251636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.319s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-0550bf27-5c46-4460-a049-f745771f2477 tempest-ProjectReaderTests-170251636 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:28:59 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-0550bf27-5c46-4460-a049-f745771f2477 tempest-ProjectReaderTests-170251636 None] Deleted volume successfully. Nov 03 13:28:59 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3819c29c-9e8c-4f19-9388-7333e840a567 tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070" returned: 0 in 0.489s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3819c29c-9e8c-4f19-9388-7333e840a567 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0550bf27-5c46-4460-a049-f745771f2477 tempest-ProjectReaderTests-170251636 None] Lock "cinder-b3cb9d85-0d1e-49f8-bd6b-fcbb962e5978-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:59 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070 Nov 03 13:28:59 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:59 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.321s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager._thread_info {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread count: 28 {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread info: [<_MainThread(MainThread, started 133507074375808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:28:59 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7ebd7ff1-79b9-46f7-a8e4-e60aa6d53c1a tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9.59737688-8c68-4907-b468-0456e21a1bdd" returned: 0 in 0.346s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7ebd7ff1-79b9-46f7-a8e4-e60aa6d53c1a tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:59 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9.info Nov 03 13:28:59 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:59 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3819c29c-9e8c-4f19-9388-7333e840a567 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-bb58d631-4de1-49bf-bb47-9efff22f8070" returned: 0 in 0.313s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3819c29c-9e8c-4f19-9388-7333e840a567 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-bb58d631-4de1-49bf-bb47-9efff22f8070" released by "delete_volume" :: held 0.877s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] Flow 'volume_create_manager' (a9b0104d-f014-4ee6-890a-10cef9571d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca6e747a-790e-441a-8b5d-c3c080610bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-3819c29c-9e8c-4f19-9388-7333e840a567 tempest-ProjectMemberTests-1676407320 None] Created reservations ['99e2c3ea-8c41-4f72-ae23-a3cf5b3acdb7', 'e2a527ae-22cb-4e1a-9439-3e254f0ec730', '247108f8-4630-4974-9dda-42ec3c4ea558', 'd7c5d6c0-a782-4d37-bc25-befc8d5844df'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:28:59 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca6e747a-790e-441a-8b5d-c3c080610bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1444474821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54475197-fb83-4ce5-b399-c53780649659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b68465c3b3424e3688ff1e6d8d17879a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:59Z,use_quota=True,user_id='033a1b3f19b24bf88065e5f9bece4154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa7f1d11-f5d3-4bd7-817b-fa94665ce173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa7f1d11-f5d3-4bd7-817b-fa94665ce173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b798273-b686-4690-8bc6-b7597b7cec3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b798273-b686-4690-8bc6-b7597b7cec3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54475197-fb83-4ce5-b399-c53780649659', 'volume_name': 'volume-54475197-fb83-4ce5-b399-c53780649659', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19674807-68f0-4e9f-9c64-9d0362c4c961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19674807-68f0-4e9f-9c64-9d0362c4c961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c14cae3-ea41-450f-a949-d583abf1f63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:28:59 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] Volume 54475197-fb83-4ce5-b399-c53780649659: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54475197-fb83-4ce5-b399-c53780649659', 'volume_size': 1} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7ebd7ff1-79b9-46f7-a8e4-e60aa6d53c1a tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9.info" returned: 0 in 0.368s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:59 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-7ebd7ff1-79b9-46f7-a8e4-e60aa6d53c1a tempest-ProjectReaderTests-2033320378 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9.info is being set with open permissions: ugo+rw Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7ebd7ff1-79b9-46f7-a8e4-e60aa6d53c1a tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:59 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9.info Nov 03 13:28:59 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3819c29c-9e8c-4f19-9388-7333e840a567 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3819c29c-9e8c-4f19-9388-7333e840a567 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3819c29c-9e8c-4f19-9388-7333e840a567 tempest-ProjectMemberTests-1676407320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3819c29c-9e8c-4f19-9388-7333e840a567 tempest-ProjectMemberTests-1676407320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3819c29c-9e8c-4f19-9388-7333e840a567 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3819c29c-9e8c-4f19-9388-7333e840a567 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:59 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:28:59 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:59 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-7ebd7ff1-79b9-46f7-a8e4-e60aa6d53c1a tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9.info" returned: 0 in 0.253s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-7ebd7ff1-79b9-46f7-a8e4-e60aa6d53c1a tempest-ProjectReaderTests-2033320378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.298s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.284s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1444474821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54475197-fb83-4ce5-b399-c53780649659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b68465c3b3424e3688ff1e6d8d17879a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:28:59Z,use_quota=True,user_id='033a1b3f19b24bf88065e5f9bece4154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] Creating volume 54475197-fb83-4ce5-b399-c53780649659 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:28:59 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-54475197-fb83-4ce5-b399-c53780649659 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:28:59 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-54475197-fb83-4ce5-b399-c53780649659 1073741824 Nov 03 13:28:59 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:28:59 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3819c29c-9e8c-4f19-9388-7333e840a567 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.261s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3819c29c-9e8c-4f19-9388-7333e840a567 tempest-ProjectMemberTests-1676407320 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:28:59 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-3819c29c-9e8c-4f19-9388-7333e840a567 tempest-ProjectMemberTests-1676407320 None] Deleted volume successfully. Nov 03 13:28:59 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-7ebd7ff1-79b9-46f7-a8e4-e60aa6d53c1a tempest-ProjectReaderTests-2033320378 None] Create snapshot completed successfully Nov 03 13:28:59 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3819c29c-9e8c-4f19-9388-7333e840a567 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-bb58d631-4de1-49bf-bb47-9efff22f8070-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:00 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-54475197-fb83-4ce5-b399-c53780649659 1073741824" returned: 0 in 0.411s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-54475197-fb83-4ce5-b399-c53780649659 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:00 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-54475197-fb83-4ce5-b399-c53780649659 Nov 03 13:29:00 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:00 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-54475197-fb83-4ce5-b399-c53780649659" returned: 0 in 0.245s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:00 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:29:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:29:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c14cae3-ea41-450f-a949-d583abf1f63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54475197-fb83-4ce5-b399-c53780649659', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9daa0658-6c05-4468-8916-03187ed49daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:00 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] Volume volume-54475197-fb83-4ce5-b399-c53780649659 (54475197-fb83-4ce5-b399-c53780649659): created successfully Nov 03 13:29:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9daa0658-6c05-4468-8916-03187ed49daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:00 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] Flow 'volume_create_manager' (a9b0104d-f014-4ee6-890a-10cef9571d59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:29:00 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-a0dede2e-36c7-4f68-b74f-76cdcb918fd7 tempest-ProjectReaderTests-170251636 None] Created volume successfully. Nov 03 13:29:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3c3b0ae0-f31e-4be9-a8d3-10ddcf19b165 tempest-ProjectReaderTests-2033320378 None] Acquiring lock "cinder-59737688-8c68-4907-b468-0456e21a1bdd-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3c3b0ae0-f31e-4be9-a8d3-10ddcf19b165 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-59737688-8c68-4907-b468-0456e21a1bdd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3c3b0ae0-f31e-4be9-a8d3-10ddcf19b165 tempest-ProjectReaderTests-2033320378 None] Acquiring lock "cinder-quobyte-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3c3b0ae0-f31e-4be9-a8d3-10ddcf19b165 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-quobyte-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3c3b0ae0-f31e-4be9-a8d3-10ddcf19b165 tempest-ProjectReaderTests-2033320378 None] Acquiring lock "cinder-quobyte-59737688-8c68-4907-b468-0456e21a1bdd" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:00 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3c3b0ae0-f31e-4be9-a8d3-10ddcf19b165 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-quobyte-59737688-8c68-4907-b468-0456e21a1bdd" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:00 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-3c3b0ae0-f31e-4be9-a8d3-10ddcf19b165 tempest-ProjectReaderTests-2033320378 None] Deleting offline snapshot 59737688-8c68-4907-b468-0456e21a1bdd of volume 938f1b5f-7b9e-4b43-b7aa-9261f71f26c9 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:29:00 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-3c3b0ae0-f31e-4be9-a8d3-10ddcf19b165 tempest-ProjectReaderTests-2033320378 None] snapshot_file for this snap is: volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9.59737688-8c68-4907-b468-0456e21a1bdd {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:29:00 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[61eb71b5-753a-4a5a-9594-837c9e3efddf]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:29:00 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3c3b0ae0-f31e-4be9-a8d3-10ddcf19b165 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9.59737688-8c68-4907-b468-0456e21a1bdd {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:00 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9.59737688-8c68-4907-b468-0456e21a1bdd Nov 03 13:29:00 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] Flow 'volume_create_manager' (466e0842-bcb4-4e18-a677-7ffe9f11edd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a2e439-97a1-4bb1-b7dc-11082f9f9a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a2e439-97a1-4bb1-b7dc-11082f9f9a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1403890504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67641f61-4453-4ce9-b87b-04c76427c616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60ac3b296fa402ebc45563747540073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:29:01Z,use_quota=True,user_id='82e28082879940beb510c24ff3452f75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f87f1f4-dfc2-4fca-bec0-431334eebb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f87f1f4-dfc2-4fca-bec0-431334eebb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d1cd6cf-7bcd-491f-8d85-2aaee8fde014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d1cd6cf-7bcd-491f-8d85-2aaee8fde014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67641f61-4453-4ce9-b87b-04c76427c616', 'volume_name': 'volume-67641f61-4453-4ce9-b87b-04c76427c616', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98592281-2594-4093-9f9d-3c709030f59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:01 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98592281-2594-4093-9f9d-3c709030f59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1653c0aa-652f-4238-8d69-5667c846a67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:01 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] Volume 67641f61-4453-4ce9-b87b-04c76427c616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67641f61-4453-4ce9-b87b-04c76427c616', 'volume_size': 1} Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1403890504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67641f61-4453-4ce9-b87b-04c76427c616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60ac3b296fa402ebc45563747540073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:29:01Z,use_quota=True,user_id='82e28082879940beb510c24ff3452f75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] Creating volume 67641f61-4453-4ce9-b87b-04c76427c616 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:29:01 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3c3b0ae0-f31e-4be9-a8d3-10ddcf19b165 tempest-ProjectReaderTests-2033320378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9.59737688-8c68-4907-b468-0456e21a1bdd" returned: 0 in 0.446s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-3c3b0ae0-f31e-4be9-a8d3-10ddcf19b165 tempest-ProjectReaderTests-2033320378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:29:01 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616 1073741824 Nov 03 13:29:01 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8f4b54-d022-4d07-8425-9b47afb5635c]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3c3b0ae0-f31e-4be9-a8d3-10ddcf19b165 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:01 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9 Nov 03 13:29:01 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-05d40b38-91cf-4db9-9635-f82ca07eb91d tempest-ProjectReaderTests-170251636 None] Acquiring lock "cinder-54475197-fb83-4ce5-b399-c53780649659-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-05d40b38-91cf-4db9-9635-f82ca07eb91d tempest-ProjectReaderTests-170251636 None] Lock "cinder-54475197-fb83-4ce5-b399-c53780649659-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-05d40b38-91cf-4db9-9635-f82ca07eb91d tempest-ProjectReaderTests-170251636 None] Acquiring lock "cinder-quobyte-54475197-fb83-4ce5-b399-c53780649659" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-05d40b38-91cf-4db9-9635-f82ca07eb91d tempest-ProjectReaderTests-170251636 None] Lock "cinder-quobyte-54475197-fb83-4ce5-b399-c53780649659" acquired by "delete_volume" :: waited 0.022s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:01 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:01 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3c3b0ae0-f31e-4be9-a8d3-10ddcf19b165 tempest-ProjectReaderTests-2033320378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9" returned: 0 in 0.448s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3c3b0ae0-f31e-4be9-a8d3-10ddcf19b165 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9.59737688-8c68-4907-b468-0456e21a1bdd {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616 1073741824" returned: 0 in 0.504s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdedaebc-0dd5-4dda-bbaf-e23b7c8dc54f]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-05d40b38-91cf-4db9-9635-f82ca07eb91d tempest-ProjectReaderTests-170251636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-54475197-fb83-4ce5-b399-c53780649659 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:01 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9.59737688-8c68-4907-b468-0456e21a1bdd Nov 03 13:29:01 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:01 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:01 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616 Nov 03 13:29:01 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:01 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-54475197-fb83-4ce5-b399-c53780649659 Nov 03 13:29:01 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:02 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616" returned: 0 in 0.270s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:02 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:29:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:29:02 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1653c0aa-652f-4238-8d69-5667c846a67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67641f61-4453-4ce9-b87b-04c76427c616', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aeed13a-6e23-48e8-891f-9ce40b81fcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3c3b0ae0-f31e-4be9-a8d3-10ddcf19b165 tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9.59737688-8c68-4907-b468-0456e21a1bdd" returned: 0 in 0.373s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3c3b0ae0-f31e-4be9-a8d3-10ddcf19b165 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9.59737688-8c68-4907-b468-0456e21a1bdd {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:02 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] Volume volume-67641f61-4453-4ce9-b87b-04c76427c616 (67641f61-4453-4ce9-b87b-04c76427c616): created successfully Nov 03 13:29:02 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9.59737688-8c68-4907-b468-0456e21a1bdd Nov 03 13:29:02 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aeed13a-6e23-48e8-891f-9ce40b81fcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:02 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] Flow 'volume_create_manager' (466e0842-bcb4-4e18-a677-7ffe9f11edd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:29:02 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-63e403af-fc26-4a5e-983d-5786d7878961 tempest-ProjectMemberTests-1676407320 None] Created volume successfully. Nov 03 13:29:02 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-05d40b38-91cf-4db9-9635-f82ca07eb91d tempest-ProjectReaderTests-170251636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-54475197-fb83-4ce5-b399-c53780649659" returned: 0 in 0.416s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-05d40b38-91cf-4db9-9635-f82ca07eb91d tempest-ProjectReaderTests-170251636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-54475197-fb83-4ce5-b399-c53780649659 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:02 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-54475197-fb83-4ce5-b399-c53780649659 Nov 03 13:29:02 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:02 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3c3b0ae0-f31e-4be9-a8d3-10ddcf19b165 tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9.59737688-8c68-4907-b468-0456e21a1bdd" returned: 0 in 0.263s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3c3b0ae0-f31e-4be9-a8d3-10ddcf19b165 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-quobyte-59737688-8c68-4907-b468-0456e21a1bdd" released by "_delete_snapshot" :: held 1.639s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3c3b0ae0-f31e-4be9-a8d3-10ddcf19b165 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-quobyte-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9" released by "delete_snapshot" :: held 1.662s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:02 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-05d40b38-91cf-4db9-9635-f82ca07eb91d tempest-ProjectReaderTests-170251636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-54475197-fb83-4ce5-b399-c53780649659" returned: 0 in 0.252s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-05d40b38-91cf-4db9-9635-f82ca07eb91d tempest-ProjectReaderTests-170251636 None] Lock "cinder-quobyte-54475197-fb83-4ce5-b399-c53780649659" released by "delete_volume" :: held 0.736s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:02 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-3c3b0ae0-f31e-4be9-a8d3-10ddcf19b165 tempest-ProjectReaderTests-2033320378 None] Created reservations ['58a71fbb-0736-4366-b941-4a7b5ae40ab8', 'f33bfe56-0ec0-4168-ade6-412fccc952ed', '5109544a-2a37-4139-a0eb-479bcb4e4d6d', '70f309fd-59af-4e9e-b95e-100e406ed13a'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:29:02 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-05d40b38-91cf-4db9-9635-f82ca07eb91d tempest-ProjectReaderTests-170251636 None] Created reservations ['39bd89ce-16d3-4ca4-8c51-67436fd51e81', 'be2616a3-52cc-4e52-9f49-b46025998433', 'b9e437cf-f885-479c-ba0a-e93f0dd9a947', '7624a0f8-eacd-4452-bf17-20214eb236d3'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:29:02 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-3c3b0ae0-f31e-4be9-a8d3-10ddcf19b165 tempest-ProjectReaderTests-2033320378 None] Delete snapshot completed successfully. Nov 03 13:29:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-3c3b0ae0-f31e-4be9-a8d3-10ddcf19b165 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-59737688-8c68-4907-b468-0456e21a1bdd-delete_snapshot" released by "delete_snapshot" :: held 1.835s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-05d40b38-91cf-4db9-9635-f82ca07eb91d tempest-ProjectReaderTests-170251636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:29:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-05d40b38-91cf-4db9-9635-f82ca07eb91d tempest-ProjectReaderTests-170251636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:29:02 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-05d40b38-91cf-4db9-9635-f82ca07eb91d tempest-ProjectReaderTests-170251636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:29:02 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-05d40b38-91cf-4db9-9635-f82ca07eb91d tempest-ProjectReaderTests-170251636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:29:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-05d40b38-91cf-4db9-9635-f82ca07eb91d tempest-ProjectReaderTests-170251636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:29:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-05d40b38-91cf-4db9-9635-f82ca07eb91d tempest-ProjectReaderTests-170251636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:02 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:29:02 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:02 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:02 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-05d40b38-91cf-4db9-9635-f82ca07eb91d tempest-ProjectReaderTests-170251636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.267s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:02 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-05d40b38-91cf-4db9-9635-f82ca07eb91d tempest-ProjectReaderTests-170251636 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:29:02 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-05d40b38-91cf-4db9-9635-f82ca07eb91d tempest-ProjectReaderTests-170251636 None] Deleted volume successfully. Nov 03 13:29:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-05d40b38-91cf-4db9-9635-f82ca07eb91d tempest-ProjectReaderTests-170251636 None] Lock "cinder-54475197-fb83-4ce5-b399-c53780649659-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-2f9553d7-aef8-476e-99ba-f9680c044084 tempest-ProjectReaderTests-2033320378 None] Acquiring lock "cinder-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:02 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-2f9553d7-aef8-476e-99ba-f9680c044084 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:03 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-2f9553d7-aef8-476e-99ba-f9680c044084 tempest-ProjectReaderTests-2033320378 None] Acquiring lock "cinder-quobyte-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:03 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-2f9553d7-aef8-476e-99ba-f9680c044084 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-quobyte-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9" acquired by "delete_volume" :: waited 0.018s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:03 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d31ad2-e322-434d-a39f-bb3f0cd4ad9a]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:29:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2f9553d7-aef8-476e-99ba-f9680c044084 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:03 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9 Nov 03 13:29:03 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2e741304-4b59-442e-8f30-50138db26df2 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:29:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2e741304-4b59-442e-8f30-50138db26df2 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:29:03 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2f9553d7-aef8-476e-99ba-f9680c044084 tempest-ProjectReaderTests-2033320378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9" returned: 0 in 0.427s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2f9553d7-aef8-476e-99ba-f9680c044084 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:03 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-2e741304-4b59-442e-8f30-50138db26df2 tempest-ProjectMemberTests-1676407320 None] Creating offline snapshot da8fde49-29a5-4f77-91ab-cb763197f8f7 of volume 67641f61-4453-4ce9-b87b-04c76427c616 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:29:03 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9 Nov 03 13:29:03 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:03 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba8af40-aaa5-4d3d-a0c7-7c53627852d2]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:29:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2e741304-4b59-442e-8f30-50138db26df2 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:03 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616 Nov 03 13:29:03 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:03 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2f9553d7-aef8-476e-99ba-f9680c044084 tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9" returned: 0 in 0.267s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:03 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-2f9553d7-aef8-476e-99ba-f9680c044084 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-quobyte-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9" released by "delete_volume" :: held 0.765s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:03 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-2f9553d7-aef8-476e-99ba-f9680c044084 tempest-ProjectReaderTests-2033320378 None] Created reservations ['d2ee72b0-0c24-45cd-ae74-2b2cce4b92a1', '3266f81e-3c1d-4a5e-818a-5ad65b51a888', 'a12b84ab-a70b-49cc-a2d1-4e983e457e1e', '182b35c0-486a-4cb3-8318-fd925db36415'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:29:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2f9553d7-aef8-476e-99ba-f9680c044084 tempest-ProjectReaderTests-2033320378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:29:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2f9553d7-aef8-476e-99ba-f9680c044084 tempest-ProjectReaderTests-2033320378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:29:03 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2f9553d7-aef8-476e-99ba-f9680c044084 tempest-ProjectReaderTests-2033320378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:29:03 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-2f9553d7-aef8-476e-99ba-f9680c044084 tempest-ProjectReaderTests-2033320378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:29:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2f9553d7-aef8-476e-99ba-f9680c044084 tempest-ProjectReaderTests-2033320378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:29:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2f9553d7-aef8-476e-99ba-f9680c044084 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:03 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2e741304-4b59-442e-8f30-50138db26df2 tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616" returned: 0 in 0.420s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:03 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2e741304-4b59-442e-8f30-50138db26df2 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616.da8fde49-29a5-4f77-91ab-cb763197f8f7 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:03 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:29:03 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:04 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616.da8fde49-29a5-4f77-91ab-cb763197f8f7 1G Nov 03 13:29:04 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:04 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2f9553d7-aef8-476e-99ba-f9680c044084 tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.347s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:04 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-2f9553d7-aef8-476e-99ba-f9680c044084 tempest-ProjectReaderTests-2033320378 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:29:04 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-2f9553d7-aef8-476e-99ba-f9680c044084 tempest-ProjectReaderTests-2033320378 None] Deleted volume successfully. Nov 03 13:29:04 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-2f9553d7-aef8-476e-99ba-f9680c044084 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-938f1b5f-7b9e-4b43-b7aa-9261f71f26c9-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:04 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2e741304-4b59-442e-8f30-50138db26df2 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616.da8fde49-29a5-4f77-91ab-cb763197f8f7 1G" returned: 0 in 0.651s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2e741304-4b59-442e-8f30-50138db26df2 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67641f61-4453-4ce9-b87b-04c76427c616 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616.da8fde49-29a5-4f77-91ab-cb763197f8f7 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:04 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67641f61-4453-4ce9-b87b-04c76427c616 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616.da8fde49-29a5-4f77-91ab-cb763197f8f7 Nov 03 13:29:04 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:04 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:29:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] Flow 'volume_create_manager' (3ec77767-d938-4abf-860e-b26eb9f32734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:29:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec65056-9abc-48c1-93a7-bc6dc6af3656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec65056-9abc-48c1-93a7-bc6dc6af3656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1406067993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=410f8d0a-5833-4f5a-b39e-807a335e649d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d44080166948cea704fa07a936c807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:29:05Z,use_quota=True,user_id='eaeace3300d748f19b758c594a4c4ee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8451d8b2-4ba0-4dfe-8388-c1cc2eb1a0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8451d8b2-4ba0-4dfe-8388-c1cc2eb1a0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39329d3b-7719-4af2-8329-0bb021481b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39329d3b-7719-4af2-8329-0bb021481b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '410f8d0a-5833-4f5a-b39e-807a335e649d', 'volume_name': 'volume-410f8d0a-5833-4f5a-b39e-807a335e649d', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40082916-678d-4d7e-9c43-1073efbff886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40082916-678d-4d7e-9c43-1073efbff886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:04 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (714b7300-75ea-4ff2-8beb-5573089b05a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:04 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] Volume 410f8d0a-5833-4f5a-b39e-807a335e649d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-410f8d0a-5833-4f5a-b39e-807a335e649d', 'volume_size': 1} Nov 03 13:29:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:29:04 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2e741304-4b59-442e-8f30-50138db26df2 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67641f61-4453-4ce9-b87b-04c76427c616 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616.da8fde49-29a5-4f77-91ab-cb763197f8f7" returned: 0 in 0.316s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:04 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-2e741304-4b59-442e-8f30-50138db26df2 tempest-ProjectMemberTests-1676407320 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616.da8fde49-29a5-4f77-91ab-cb763197f8f7 is being set with open permissions: ugo+rw Nov 03 13:29:04 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2e741304-4b59-442e-8f30-50138db26df2 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616.da8fde49-29a5-4f77-91ab-cb763197f8f7 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:04 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616.da8fde49-29a5-4f77-91ab-cb763197f8f7 Nov 03 13:29:04 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:05 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2e741304-4b59-442e-8f30-50138db26df2 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616.da8fde49-29a5-4f77-91ab-cb763197f8f7" returned: 0 in 0.243s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2e741304-4b59-442e-8f30-50138db26df2 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:05 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616.info Nov 03 13:29:05 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:05 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2e741304-4b59-442e-8f30-50138db26df2 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616.info" returned: 0 in 0.244s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:05 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-2e741304-4b59-442e-8f30-50138db26df2 tempest-ProjectMemberTests-1676407320 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616.info is being set with open permissions: ugo+rw Nov 03 13:29:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2e741304-4b59-442e-8f30-50138db26df2 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:05 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616.info Nov 03 13:29:05 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:05 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-2e741304-4b59-442e-8f30-50138db26df2 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616.info" returned: 0 in 0.246s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-2e741304-4b59-442e-8f30-50138db26df2 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.231s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:29:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.878s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:29:05 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1406067993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=410f8d0a-5833-4f5a-b39e-807a335e649d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d44080166948cea704fa07a936c807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:29:05Z,use_quota=True,user_id='eaeace3300d748f19b758c594a4c4ee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:29:05 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] Creating volume 410f8d0a-5833-4f5a-b39e-807a335e649d {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:29:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:29:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:29:05 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:29:05 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:29:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:29:05 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:29:05 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:29:05 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:05 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d 1073741824 Nov 03 13:29:05 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:05 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-2e741304-4b59-442e-8f30-50138db26df2 tempest-ProjectMemberTests-1676407320 None] Create snapshot completed successfully Nov 03 13:29:06 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d 1073741824" returned: 0 in 0.399s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:06 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d Nov 03 13:29:06 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:06 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d" returned: 0 in 0.241s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:06 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:29:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:29:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (714b7300-75ea-4ff2-8beb-5573089b05a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-410f8d0a-5833-4f5a-b39e-807a335e649d', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4fe73ea-b321-4e76-94f8-6a61f9bc7e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:06 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] Volume volume-410f8d0a-5833-4f5a-b39e-807a335e649d (410f8d0a-5833-4f5a-b39e-807a335e649d): created successfully Nov 03 13:29:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4fe73ea-b321-4e76-94f8-6a61f9bc7e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:06 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] Flow 'volume_create_manager' (3ec77767-d938-4abf-860e-b26eb9f32734) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:29:06 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-46cbb020-5bd8-4d20-a29e-55cb9da42715 tempest-ProjectReaderTests-2033320378 None] Created volume successfully. Nov 03 13:29:06 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8dc03d3b-031a-449a-906d-2e9f10271fbd tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-da8fde49-29a5-4f77-91ab-cb763197f8f7-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:06 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8dc03d3b-031a-449a-906d-2e9f10271fbd tempest-ProjectMemberTests-1676407320 None] Lock "cinder-da8fde49-29a5-4f77-91ab-cb763197f8f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:06 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8dc03d3b-031a-449a-906d-2e9f10271fbd tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-quobyte-67641f61-4453-4ce9-b87b-04c76427c616" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:06 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8dc03d3b-031a-449a-906d-2e9f10271fbd tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-67641f61-4453-4ce9-b87b-04c76427c616" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:06 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8dc03d3b-031a-449a-906d-2e9f10271fbd tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-quobyte-da8fde49-29a5-4f77-91ab-cb763197f8f7" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:06 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8dc03d3b-031a-449a-906d-2e9f10271fbd tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-da8fde49-29a5-4f77-91ab-cb763197f8f7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:06 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-8dc03d3b-031a-449a-906d-2e9f10271fbd tempest-ProjectMemberTests-1676407320 None] Deleting offline snapshot da8fde49-29a5-4f77-91ab-cb763197f8f7 of volume 67641f61-4453-4ce9-b87b-04c76427c616 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:29:06 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-8dc03d3b-031a-449a-906d-2e9f10271fbd tempest-ProjectMemberTests-1676407320 None] snapshot_file for this snap is: volume-67641f61-4453-4ce9-b87b-04c76427c616.da8fde49-29a5-4f77-91ab-cb763197f8f7 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:29:06 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b220439-2512-4af1-8ab9-75763e020a52]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:29:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8dc03d3b-031a-449a-906d-2e9f10271fbd tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616.da8fde49-29a5-4f77-91ab-cb763197f8f7 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:06 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616.da8fde49-29a5-4f77-91ab-cb763197f8f7 Nov 03 13:29:06 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5694296b-0ac3-4da5-8e5d-4075f5137bac tempest-ProjectReaderTests-2033320378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:29:06 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5694296b-0ac3-4da5-8e5d-4075f5137bac tempest-ProjectReaderTests-2033320378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:29:06 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-5694296b-0ac3-4da5-8e5d-4075f5137bac tempest-ProjectReaderTests-2033320378 None] Creating offline snapshot 216aa104-a8e5-4cd6-8c78-0bf113026991 of volume 410f8d0a-5833-4f5a-b39e-807a335e649d {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:29:07 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[5522734d-b8c1-43d1-8a2b-092fdc5302b7]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:29:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5694296b-0ac3-4da5-8e5d-4075f5137bac tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:07 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8dc03d3b-031a-449a-906d-2e9f10271fbd tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616.da8fde49-29a5-4f77-91ab-cb763197f8f7" returned: 0 in 0.367s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:07 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-8dc03d3b-031a-449a-906d-2e9f10271fbd tempest-ProjectMemberTests-1676407320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67641f61-4453-4ce9-b87b-04c76427c616(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:29:07 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d Nov 03 13:29:07 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:07 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ec4c61-c3f2-43f1-9125-3999346302d9]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:29:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8dc03d3b-031a-449a-906d-2e9f10271fbd tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:07 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616 Nov 03 13:29:07 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:07 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5694296b-0ac3-4da5-8e5d-4075f5137bac tempest-ProjectReaderTests-2033320378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d" returned: 0 in 0.380s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5694296b-0ac3-4da5-8e5d-4075f5137bac tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d.216aa104-a8e5-4cd6-8c78-0bf113026991 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:07 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d.216aa104-a8e5-4cd6-8c78-0bf113026991 1G Nov 03 13:29:07 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:07 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8dc03d3b-031a-449a-906d-2e9f10271fbd tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616" returned: 0 in 0.371s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8dc03d3b-031a-449a-906d-2e9f10271fbd tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616.da8fde49-29a5-4f77-91ab-cb763197f8f7 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:07 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616.da8fde49-29a5-4f77-91ab-cb763197f8f7 Nov 03 13:29:07 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:07 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5694296b-0ac3-4da5-8e5d-4075f5137bac tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d.216aa104-a8e5-4cd6-8c78-0bf113026991 1G" returned: 0 in 0.408s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5694296b-0ac3-4da5-8e5d-4075f5137bac tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-410f8d0a-5833-4f5a-b39e-807a335e649d -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d.216aa104-a8e5-4cd6-8c78-0bf113026991 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:07 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-410f8d0a-5833-4f5a-b39e-807a335e649d -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d.216aa104-a8e5-4cd6-8c78-0bf113026991 Nov 03 13:29:07 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:07 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8dc03d3b-031a-449a-906d-2e9f10271fbd tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616.da8fde49-29a5-4f77-91ab-cb763197f8f7" returned: 0 in 0.357s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:07 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8dc03d3b-031a-449a-906d-2e9f10271fbd tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616.da8fde49-29a5-4f77-91ab-cb763197f8f7 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:07 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616.da8fde49-29a5-4f77-91ab-cb763197f8f7 Nov 03 13:29:07 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:08 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5694296b-0ac3-4da5-8e5d-4075f5137bac tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-410f8d0a-5833-4f5a-b39e-807a335e649d -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d.216aa104-a8e5-4cd6-8c78-0bf113026991" returned: 0 in 0.292s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:08 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-5694296b-0ac3-4da5-8e5d-4075f5137bac tempest-ProjectReaderTests-2033320378 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d.216aa104-a8e5-4cd6-8c78-0bf113026991 is being set with open permissions: ugo+rw Nov 03 13:29:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5694296b-0ac3-4da5-8e5d-4075f5137bac tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d.216aa104-a8e5-4cd6-8c78-0bf113026991 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:08 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d.216aa104-a8e5-4cd6-8c78-0bf113026991 Nov 03 13:29:08 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:08 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8dc03d3b-031a-449a-906d-2e9f10271fbd tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616.da8fde49-29a5-4f77-91ab-cb763197f8f7" returned: 0 in 0.263s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:08 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8dc03d3b-031a-449a-906d-2e9f10271fbd tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-da8fde49-29a5-4f77-91ab-cb763197f8f7" released by "_delete_snapshot" :: held 1.464s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:08 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8dc03d3b-031a-449a-906d-2e9f10271fbd tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-67641f61-4453-4ce9-b87b-04c76427c616" released by "delete_snapshot" :: held 1.486s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:08 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-8dc03d3b-031a-449a-906d-2e9f10271fbd tempest-ProjectMemberTests-1676407320 None] Created reservations ['07d24acc-2ede-48d8-abb7-ada42a024888', '0f11599d-6785-4b22-90fd-0886ecda42db', '83fc1ff1-7a6a-44a5-80de-1ea4c2d8a24f', '52d21e75-b3ee-4628-9857-70e06146bef4'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:29:08 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-8dc03d3b-031a-449a-906d-2e9f10271fbd tempest-ProjectMemberTests-1676407320 None] Delete snapshot completed successfully. Nov 03 13:29:08 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8dc03d3b-031a-449a-906d-2e9f10271fbd tempest-ProjectMemberTests-1676407320 None] Lock "cinder-da8fde49-29a5-4f77-91ab-cb763197f8f7-delete_snapshot" released by "delete_snapshot" :: held 1.616s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:08 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5694296b-0ac3-4da5-8e5d-4075f5137bac tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d.216aa104-a8e5-4cd6-8c78-0bf113026991" returned: 0 in 0.251s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5694296b-0ac3-4da5-8e5d-4075f5137bac tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:08 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d.info Nov 03 13:29:08 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:08 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5694296b-0ac3-4da5-8e5d-4075f5137bac tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d.info" returned: 0 in 0.250s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:08 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-5694296b-0ac3-4da5-8e5d-4075f5137bac tempest-ProjectReaderTests-2033320378 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d.info is being set with open permissions: ugo+rw Nov 03 13:29:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5694296b-0ac3-4da5-8e5d-4075f5137bac tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:08 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d.info Nov 03 13:29:08 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:08 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e2057328-a49b-4afc-abc2-795b42a08613 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-67641f61-4453-4ce9-b87b-04c76427c616-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:08 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e2057328-a49b-4afc-abc2-795b42a08613 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-67641f61-4453-4ce9-b87b-04c76427c616-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:08 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5694296b-0ac3-4da5-8e5d-4075f5137bac tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d.info" returned: 0 in 0.255s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5694296b-0ac3-4da5-8e5d-4075f5137bac tempest-ProjectReaderTests-2033320378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.914s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:29:08 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e2057328-a49b-4afc-abc2-795b42a08613 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-quobyte-67641f61-4453-4ce9-b87b-04c76427c616" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:08 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e2057328-a49b-4afc-abc2-795b42a08613 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-67641f61-4453-4ce9-b87b-04c76427c616" acquired by "delete_volume" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:08 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-5694296b-0ac3-4da5-8e5d-4075f5137bac tempest-ProjectReaderTests-2033320378 None] Create snapshot completed successfully Nov 03 13:29:08 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cd31fa-39db-489e-a6ed-d3c22e2efed8]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:29:08 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e2057328-a49b-4afc-abc2-795b42a08613 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:09 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616 Nov 03 13:29:09 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:09 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-16689e5f-9296-487e-954e-4b11345d3fda tempest-ProjectReaderTests-2033320378 None] Acquiring lock "cinder-216aa104-a8e5-4cd6-8c78-0bf113026991-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:09 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-16689e5f-9296-487e-954e-4b11345d3fda tempest-ProjectReaderTests-2033320378 None] Lock "cinder-216aa104-a8e5-4cd6-8c78-0bf113026991-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:09 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-16689e5f-9296-487e-954e-4b11345d3fda tempest-ProjectReaderTests-2033320378 None] Acquiring lock "cinder-quobyte-410f8d0a-5833-4f5a-b39e-807a335e649d" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:09 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-16689e5f-9296-487e-954e-4b11345d3fda tempest-ProjectReaderTests-2033320378 None] Lock "cinder-quobyte-410f8d0a-5833-4f5a-b39e-807a335e649d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:09 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-16689e5f-9296-487e-954e-4b11345d3fda tempest-ProjectReaderTests-2033320378 None] Acquiring lock "cinder-quobyte-216aa104-a8e5-4cd6-8c78-0bf113026991" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:09 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-16689e5f-9296-487e-954e-4b11345d3fda tempest-ProjectReaderTests-2033320378 None] Lock "cinder-quobyte-216aa104-a8e5-4cd6-8c78-0bf113026991" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:09 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-16689e5f-9296-487e-954e-4b11345d3fda tempest-ProjectReaderTests-2033320378 None] Deleting offline snapshot 216aa104-a8e5-4cd6-8c78-0bf113026991 of volume 410f8d0a-5833-4f5a-b39e-807a335e649d {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:29:09 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-16689e5f-9296-487e-954e-4b11345d3fda tempest-ProjectReaderTests-2033320378 None] snapshot_file for this snap is: volume-410f8d0a-5833-4f5a-b39e-807a335e649d.216aa104-a8e5-4cd6-8c78-0bf113026991 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:29:09 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[673648f7-8455-473f-af9e-67fbf444eed8]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:29:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-16689e5f-9296-487e-954e-4b11345d3fda tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d.216aa104-a8e5-4cd6-8c78-0bf113026991 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:09 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d.216aa104-a8e5-4cd6-8c78-0bf113026991 Nov 03 13:29:09 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:09 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e2057328-a49b-4afc-abc2-795b42a08613 tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616" returned: 0 in 0.388s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e2057328-a49b-4afc-abc2-795b42a08613 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:09 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616 Nov 03 13:29:09 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:09 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-16689e5f-9296-487e-954e-4b11345d3fda tempest-ProjectReaderTests-2033320378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d.216aa104-a8e5-4cd6-8c78-0bf113026991" returned: 0 in 0.388s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:09 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-16689e5f-9296-487e-954e-4b11345d3fda tempest-ProjectReaderTests-2033320378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-410f8d0a-5833-4f5a-b39e-807a335e649d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:29:09 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e2057328-a49b-4afc-abc2-795b42a08613 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-67641f61-4453-4ce9-b87b-04c76427c616" returned: 0 in 0.270s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:09 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cac9767-aa0f-4fbd-8ccc-334b9052fe1d]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:29:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-16689e5f-9296-487e-954e-4b11345d3fda tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:09 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e2057328-a49b-4afc-abc2-795b42a08613 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-67641f61-4453-4ce9-b87b-04c76427c616" released by "delete_volume" :: held 0.736s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:09 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-e2057328-a49b-4afc-abc2-795b42a08613 tempest-ProjectMemberTests-1676407320 None] Created reservations ['1fb3f337-6cc9-4418-b52b-5f1e31afd3bd', 'b7732e6b-2828-4eca-92ca-e22bc63e20f4', 'ab1f8af1-eed5-4c47-b2e0-34eabc237cac', 'd5a047d8-eb37-45f7-8b02-67c38c08763c'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:29:09 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d Nov 03 13:29:09 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e2057328-a49b-4afc-abc2-795b42a08613 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:29:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e2057328-a49b-4afc-abc2-795b42a08613 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:29:09 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-e2057328-a49b-4afc-abc2-795b42a08613 tempest-ProjectMemberTests-1676407320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:29:09 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-e2057328-a49b-4afc-abc2-795b42a08613 tempest-ProjectMemberTests-1676407320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:29:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-e2057328-a49b-4afc-abc2-795b42a08613 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:29:09 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e2057328-a49b-4afc-abc2-795b42a08613 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:09 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:29:09 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:10 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-16689e5f-9296-487e-954e-4b11345d3fda tempest-ProjectReaderTests-2033320378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d" returned: 0 in 0.375s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-16689e5f-9296-487e-954e-4b11345d3fda tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d.216aa104-a8e5-4cd6-8c78-0bf113026991 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:10 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-e2057328-a49b-4afc-abc2-795b42a08613 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.258s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-e2057328-a49b-4afc-abc2-795b42a08613 tempest-ProjectMemberTests-1676407320 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:29:10 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d.216aa104-a8e5-4cd6-8c78-0bf113026991 Nov 03 13:29:10 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:10 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-e2057328-a49b-4afc-abc2-795b42a08613 tempest-ProjectMemberTests-1676407320 None] Deleted volume successfully. Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-e2057328-a49b-4afc-abc2-795b42a08613 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-67641f61-4453-4ce9-b87b-04c76427c616-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:10 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-16689e5f-9296-487e-954e-4b11345d3fda tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d.216aa104-a8e5-4cd6-8c78-0bf113026991" returned: 0 in 0.384s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-16689e5f-9296-487e-954e-4b11345d3fda tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d.216aa104-a8e5-4cd6-8c78-0bf113026991 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:10 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d.216aa104-a8e5-4cd6-8c78-0bf113026991 Nov 03 13:29:10 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] Flow 'volume_create_manager' (43368341-6dae-416e-af91-c4d8da288493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b00a61a8-b8ad-4da5-a6ab-00ed483f3b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b00a61a8-b8ad-4da5-a6ab-00ed483f3b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-658473830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56bd2a8c-f87d-4a02-be9a-a6dec9439541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60ac3b296fa402ebc45563747540073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:29:10Z,use_quota=True,user_id='82e28082879940beb510c24ff3452f75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19de94b1-6caa-4389-a12d-23583b40c5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19de94b1-6caa-4389-a12d-23583b40c5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39a0ab46-1040-4fd8-b6b5-b19062f3831d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39a0ab46-1040-4fd8-b6b5-b19062f3831d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56bd2a8c-f87d-4a02-be9a-a6dec9439541', 'volume_name': 'volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afa21208-3cbe-4ef1-96d6-afb2b8a503d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afa21208-3cbe-4ef1-96d6-afb2b8a503d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ccdce3a-4480-4aa2-ba4a-03b884795dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:10 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] Volume 56bd2a8c-f87d-4a02-be9a-a6dec9439541: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541', 'volume_size': 1} Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-658473830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56bd2a8c-f87d-4a02-be9a-a6dec9439541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60ac3b296fa402ebc45563747540073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:29:10Z,use_quota=True,user_id='82e28082879940beb510c24ff3452f75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] Creating volume 56bd2a8c-f87d-4a02-be9a-a6dec9439541 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:29:10 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:10 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541 1073741824 Nov 03 13:29:10 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:10 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-16689e5f-9296-487e-954e-4b11345d3fda tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d.216aa104-a8e5-4cd6-8c78-0bf113026991" returned: 0 in 0.261s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-16689e5f-9296-487e-954e-4b11345d3fda tempest-ProjectReaderTests-2033320378 None] Lock "cinder-quobyte-216aa104-a8e5-4cd6-8c78-0bf113026991" released by "_delete_snapshot" :: held 1.509s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-16689e5f-9296-487e-954e-4b11345d3fda tempest-ProjectReaderTests-2033320378 None] Lock "cinder-quobyte-410f8d0a-5833-4f5a-b39e-807a335e649d" released by "delete_snapshot" :: held 1.532s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-16689e5f-9296-487e-954e-4b11345d3fda tempest-ProjectReaderTests-2033320378 None] Created reservations ['4e585337-4fb4-462b-9a76-fd0ee106e2fa', 'f6adf937-5bdf-4374-973f-b10dcd71b93d', '6cb065f2-e8f6-4c76-ac2f-4782c0deb4d7', '0f161967-8dd3-43f9-8689-8cd3b1cd6271'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:29:10 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-16689e5f-9296-487e-954e-4b11345d3fda tempest-ProjectReaderTests-2033320378 None] Delete snapshot completed successfully. Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-16689e5f-9296-487e-954e-4b11345d3fda tempest-ProjectReaderTests-2033320378 None] Lock "cinder-216aa104-a8e5-4cd6-8c78-0bf113026991-delete_snapshot" released by "delete_snapshot" :: held 1.676s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:10 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:10 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541 1073741824" returned: 0 in 0.441s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:11 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541 Nov 03 13:29:11 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:11 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541" returned: 0 in 0.251s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:11 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:29:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:29:11 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4176ba42-8d7b-4dd3-ae8f-f3cd54cb9e36 tempest-ProjectReaderTests-2033320378 None] Acquiring lock "cinder-410f8d0a-5833-4f5a-b39e-807a335e649d-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:11 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ccdce3a-4480-4aa2-ba4a-03b884795dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:11 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed4fb10-95f7-4697-9658-77b1cdbbacff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:11 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4176ba42-8d7b-4dd3-ae8f-f3cd54cb9e36 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-410f8d0a-5833-4f5a-b39e-807a335e649d-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:11 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] Volume volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541 (56bd2a8c-f87d-4a02-be9a-a6dec9439541): created successfully Nov 03 13:29:11 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed4fb10-95f7-4697-9658-77b1cdbbacff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:11 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] Flow 'volume_create_manager' (43368341-6dae-416e-af91-c4d8da288493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:29:11 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-ebd7ff70-2f76-429c-90a8-73422e08a7c1 tempest-ProjectMemberTests-1676407320 None] Created volume successfully. Nov 03 13:29:11 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4176ba42-8d7b-4dd3-ae8f-f3cd54cb9e36 tempest-ProjectReaderTests-2033320378 None] Acquiring lock "cinder-quobyte-410f8d0a-5833-4f5a-b39e-807a335e649d" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:11 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4176ba42-8d7b-4dd3-ae8f-f3cd54cb9e36 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-quobyte-410f8d0a-5833-4f5a-b39e-807a335e649d" acquired by "delete_volume" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:11 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ebf6c0-6faa-42c5-afc8-cb1a71e05a2f]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:29:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4176ba42-8d7b-4dd3-ae8f-f3cd54cb9e36 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:11 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d Nov 03 13:29:11 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-030f589f-ce50-4848-821a-c89bf14a1b2f tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:29:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-030f589f-ce50-4848-821a-c89bf14a1b2f tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:29:11 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-030f589f-ce50-4848-821a-c89bf14a1b2f tempest-ProjectMemberTests-1676407320 None] Creating offline snapshot 2fde4abb-fa43-40cd-9857-808731a6f77a of volume 56bd2a8c-f87d-4a02-be9a-a6dec9439541 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:29:11 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddd382c-a21d-4ea7-b8b5-071c42330b75]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:29:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-030f589f-ce50-4848-821a-c89bf14a1b2f tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:11 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541 Nov 03 13:29:11 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:11 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4176ba42-8d7b-4dd3-ae8f-f3cd54cb9e36 tempest-ProjectReaderTests-2033320378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d" returned: 0 in 0.374s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:11 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4176ba42-8d7b-4dd3-ae8f-f3cd54cb9e36 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:11 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d Nov 03 13:29:11 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:12 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-030f589f-ce50-4848-821a-c89bf14a1b2f tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541" returned: 0 in 0.365s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-030f589f-ce50-4848-821a-c89bf14a1b2f tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541.2fde4abb-fa43-40cd-9857-808731a6f77a 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:12 devstack sudo[107727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541.2fde4abb-fa43-40cd-9857-808731a6f77a 1G Nov 03 13:29:12 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:12 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4176ba42-8d7b-4dd3-ae8f-f3cd54cb9e36 tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-410f8d0a-5833-4f5a-b39e-807a335e649d" returned: 0 in 0.252s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:12 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4176ba42-8d7b-4dd3-ae8f-f3cd54cb9e36 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-quobyte-410f8d0a-5833-4f5a-b39e-807a335e649d" released by "delete_volume" :: held 0.704s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:12 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-4176ba42-8d7b-4dd3-ae8f-f3cd54cb9e36 tempest-ProjectReaderTests-2033320378 None] Created reservations ['ccf3aee9-e30b-4425-9a99-4e0549106ffa', '058d6f20-9592-40cb-a5ac-497ae97fd101', 'b8cc63be-b6a2-4bcd-a44e-6e3ef9c2a67c', 'd0aa9ddd-9996-4f1e-8f52-0e256de6a14f'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:29:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4176ba42-8d7b-4dd3-ae8f-f3cd54cb9e36 tempest-ProjectReaderTests-2033320378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:29:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4176ba42-8d7b-4dd3-ae8f-f3cd54cb9e36 tempest-ProjectReaderTests-2033320378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:29:12 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4176ba42-8d7b-4dd3-ae8f-f3cd54cb9e36 tempest-ProjectReaderTests-2033320378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:29:12 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-4176ba42-8d7b-4dd3-ae8f-f3cd54cb9e36 tempest-ProjectReaderTests-2033320378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:29:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-4176ba42-8d7b-4dd3-ae8f-f3cd54cb9e36 tempest-ProjectReaderTests-2033320378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:29:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4176ba42-8d7b-4dd3-ae8f-f3cd54cb9e36 tempest-ProjectReaderTests-2033320378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:12 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:29:12 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:12 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-030f589f-ce50-4848-821a-c89bf14a1b2f tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541.2fde4abb-fa43-40cd-9857-808731a6f77a 1G" returned: 0 in 0.474s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-030f589f-ce50-4848-821a-c89bf14a1b2f tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541.2fde4abb-fa43-40cd-9857-808731a6f77a {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:12 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541.2fde4abb-fa43-40cd-9857-808731a6f77a Nov 03 13:29:12 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:12 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-4176ba42-8d7b-4dd3-ae8f-f3cd54cb9e36 tempest-ProjectReaderTests-2033320378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.278s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:12 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-4176ba42-8d7b-4dd3-ae8f-f3cd54cb9e36 tempest-ProjectReaderTests-2033320378 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:29:12 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-4176ba42-8d7b-4dd3-ae8f-f3cd54cb9e36 tempest-ProjectReaderTests-2033320378 None] Deleted volume successfully. Nov 03 13:29:12 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-4176ba42-8d7b-4dd3-ae8f-f3cd54cb9e36 tempest-ProjectReaderTests-2033320378 None] Lock "cinder-410f8d0a-5833-4f5a-b39e-807a335e649d-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:12 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-030f589f-ce50-4848-821a-c89bf14a1b2f tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541.2fde4abb-fa43-40cd-9857-808731a6f77a" returned: 0 in 0.306s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:12 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-030f589f-ce50-4848-821a-c89bf14a1b2f tempest-ProjectMemberTests-1676407320 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541.2fde4abb-fa43-40cd-9857-808731a6f77a is being set with open permissions: ugo+rw Nov 03 13:29:12 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-030f589f-ce50-4848-821a-c89bf14a1b2f tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541.2fde4abb-fa43-40cd-9857-808731a6f77a {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:12 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541.2fde4abb-fa43-40cd-9857-808731a6f77a Nov 03 13:29:12 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:13 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-030f589f-ce50-4848-821a-c89bf14a1b2f tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541.2fde4abb-fa43-40cd-9857-808731a6f77a" returned: 0 in 0.261s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-030f589f-ce50-4848-821a-c89bf14a1b2f tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:13 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541.info Nov 03 13:29:13 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:13 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-030f589f-ce50-4848-821a-c89bf14a1b2f tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541.info" returned: 0 in 0.275s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:13 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-030f589f-ce50-4848-821a-c89bf14a1b2f tempest-ProjectMemberTests-1676407320 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541.info is being set with open permissions: ugo+rw Nov 03 13:29:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-030f589f-ce50-4848-821a-c89bf14a1b2f tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:13 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541.info Nov 03 13:29:13 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:13 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-030f589f-ce50-4848-821a-c89bf14a1b2f tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541.info" returned: 0 in 0.268s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:13 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-030f589f-ce50-4848-821a-c89bf14a1b2f tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.034s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:29:13 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-030f589f-ce50-4848-821a-c89bf14a1b2f tempest-ProjectMemberTests-1676407320 None] Create snapshot completed successfully Nov 03 13:29:14 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-6afa71bb-0824-48d3-aa1b-0297df5f6fd1 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-2fde4abb-fa43-40cd-9857-808731a6f77a-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:14 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-6afa71bb-0824-48d3-aa1b-0297df5f6fd1 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-2fde4abb-fa43-40cd-9857-808731a6f77a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:14 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-6afa71bb-0824-48d3-aa1b-0297df5f6fd1 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-quobyte-56bd2a8c-f87d-4a02-be9a-a6dec9439541" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:14 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-6afa71bb-0824-48d3-aa1b-0297df5f6fd1 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-56bd2a8c-f87d-4a02-be9a-a6dec9439541" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:14 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-6afa71bb-0824-48d3-aa1b-0297df5f6fd1 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-quobyte-2fde4abb-fa43-40cd-9857-808731a6f77a" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:14 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-6afa71bb-0824-48d3-aa1b-0297df5f6fd1 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-2fde4abb-fa43-40cd-9857-808731a6f77a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:14 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-6afa71bb-0824-48d3-aa1b-0297df5f6fd1 tempest-ProjectMemberTests-1676407320 None] Deleting offline snapshot 2fde4abb-fa43-40cd-9857-808731a6f77a of volume 56bd2a8c-f87d-4a02-be9a-a6dec9439541 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:29:14 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-6afa71bb-0824-48d3-aa1b-0297df5f6fd1 tempest-ProjectMemberTests-1676407320 None] snapshot_file for this snap is: volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541.2fde4abb-fa43-40cd-9857-808731a6f77a {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:29:14 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[12356afd-7d3f-4e85-9e85-f030944f1a08]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:29:14 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-6afa71bb-0824-48d3-aa1b-0297df5f6fd1 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541.2fde4abb-fa43-40cd-9857-808731a6f77a {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:15 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541.2fde4abb-fa43-40cd-9857-808731a6f77a Nov 03 13:29:15 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:15 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-6afa71bb-0824-48d3-aa1b-0297df5f6fd1 tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541.2fde4abb-fa43-40cd-9857-808731a6f77a" returned: 0 in 0.388s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:15 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-6afa71bb-0824-48d3-aa1b-0297df5f6fd1 tempest-ProjectMemberTests-1676407320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:29:15 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b626c99-96cf-446e-a30c-d20ae539eca1]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:29:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-6afa71bb-0824-48d3-aa1b-0297df5f6fd1 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:15 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541 Nov 03 13:29:15 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:15 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-6afa71bb-0824-48d3-aa1b-0297df5f6fd1 tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541" returned: 0 in 0.376s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:15 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-6afa71bb-0824-48d3-aa1b-0297df5f6fd1 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541.2fde4abb-fa43-40cd-9857-808731a6f77a {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:15 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541.2fde4abb-fa43-40cd-9857-808731a6f77a Nov 03 13:29:15 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:16 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-6afa71bb-0824-48d3-aa1b-0297df5f6fd1 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541.2fde4abb-fa43-40cd-9857-808731a6f77a" returned: 0 in 0.382s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-6afa71bb-0824-48d3-aa1b-0297df5f6fd1 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541.2fde4abb-fa43-40cd-9857-808731a6f77a {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:16 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541.2fde4abb-fa43-40cd-9857-808731a6f77a Nov 03 13:29:16 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:16 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:16 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-6afa71bb-0824-48d3-aa1b-0297df5f6fd1 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541.2fde4abb-fa43-40cd-9857-808731a6f77a" returned: 0 in 0.251s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:16 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-6afa71bb-0824-48d3-aa1b-0297df5f6fd1 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-2fde4abb-fa43-40cd-9857-808731a6f77a" released by "_delete_snapshot" :: held 1.508s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:16 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-6afa71bb-0824-48d3-aa1b-0297df5f6fd1 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-56bd2a8c-f87d-4a02-be9a-a6dec9439541" released by "delete_snapshot" :: held 1.531s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:16 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-6afa71bb-0824-48d3-aa1b-0297df5f6fd1 tempest-ProjectMemberTests-1676407320 None] Created reservations ['bab91d5a-6b89-47b8-bf5d-853e3b2deb83', 'd10d9728-4337-4ac7-9706-d616aa3d3c7b', 'bdf7f83c-549b-4507-acbd-2a51b6c11610', '0143de49-aad1-4de8-8e0d-f1a4d9cfbdce'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:29:16 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-6afa71bb-0824-48d3-aa1b-0297df5f6fd1 tempest-ProjectMemberTests-1676407320 None] Delete snapshot completed successfully. Nov 03 13:29:16 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-6afa71bb-0824-48d3-aa1b-0297df5f6fd1 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-2fde4abb-fa43-40cd-9857-808731a6f77a-delete_snapshot" released by "delete_snapshot" :: held 1.658s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:16 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5d4b1561-01f4-40ce-8bf6-97b68a53a39e tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-56bd2a8c-f87d-4a02-be9a-a6dec9439541-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:16 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5d4b1561-01f4-40ce-8bf6-97b68a53a39e tempest-ProjectMemberTests-1676407320 None] Lock "cinder-56bd2a8c-f87d-4a02-be9a-a6dec9439541-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:17 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5d4b1561-01f4-40ce-8bf6-97b68a53a39e tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-quobyte-56bd2a8c-f87d-4a02-be9a-a6dec9439541" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:17 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5d4b1561-01f4-40ce-8bf6-97b68a53a39e tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-56bd2a8c-f87d-4a02-be9a-a6dec9439541" acquired by "delete_volume" :: waited 0.015s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:17 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[496a393d-47c5-4166-8e87-960c0bf86548]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:29:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5d4b1561-01f4-40ce-8bf6-97b68a53a39e tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:17 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541 Nov 03 13:29:17 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:17 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5d4b1561-01f4-40ce-8bf6-97b68a53a39e tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541" returned: 0 in 0.385s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5d4b1561-01f4-40ce-8bf6-97b68a53a39e tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:17 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541 Nov 03 13:29:17 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:17 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5d4b1561-01f4-40ce-8bf6-97b68a53a39e tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-56bd2a8c-f87d-4a02-be9a-a6dec9439541" returned: 0 in 0.259s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:17 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5d4b1561-01f4-40ce-8bf6-97b68a53a39e tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-56bd2a8c-f87d-4a02-be9a-a6dec9439541" released by "delete_volume" :: held 0.713s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:17 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-5d4b1561-01f4-40ce-8bf6-97b68a53a39e tempest-ProjectMemberTests-1676407320 None] Created reservations ['3539a942-6100-4c26-aad0-3f9e733bffc4', 'e1e0c3ee-88aa-4d07-ae13-4147b84f3c6c', '2cbee75f-d914-4ca9-bf55-68a7f880450d', '537df7c8-c622-4a00-8361-9d6bdbe4df5d'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:29:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5d4b1561-01f4-40ce-8bf6-97b68a53a39e tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:29:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5d4b1561-01f4-40ce-8bf6-97b68a53a39e tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:29:17 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5d4b1561-01f4-40ce-8bf6-97b68a53a39e tempest-ProjectMemberTests-1676407320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:29:17 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-5d4b1561-01f4-40ce-8bf6-97b68a53a39e tempest-ProjectMemberTests-1676407320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:29:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5d4b1561-01f4-40ce-8bf6-97b68a53a39e tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:29:17 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5d4b1561-01f4-40ce-8bf6-97b68a53a39e tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:17 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:29:17 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:18 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5d4b1561-01f4-40ce-8bf6-97b68a53a39e tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.264s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:18 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-5d4b1561-01f4-40ce-8bf6-97b68a53a39e tempest-ProjectMemberTests-1676407320 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:29:18 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-5d4b1561-01f4-40ce-8bf6-97b68a53a39e tempest-ProjectMemberTests-1676407320 None] Deleted volume successfully. Nov 03 13:29:18 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-5d4b1561-01f4-40ce-8bf6-97b68a53a39e tempest-ProjectMemberTests-1676407320 None] Lock "cinder-56bd2a8c-f87d-4a02-be9a-a6dec9439541-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:18 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:29:18 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] Flow 'volume_create_manager' (91115d7c-bf63-4076-9870-a36a9bd35aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:29:18 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57e271e4-3a8c-44d3-9701-b08ac551f910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:18 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57e271e4-3a8c-44d3-9701-b08ac551f910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-28042677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f4daba6-fcaa-48dc-b01f-eaa328b1fe59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60ac3b296fa402ebc45563747540073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:29:19Z,use_quota=True,user_id='82e28082879940beb510c24ff3452f75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:18 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5936297a-e512-4f01-8c97-7d1721780b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:18 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5936297a-e512-4f01-8c97-7d1721780b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:18 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbcd6b8f-1462-4341-9968-21f33b823ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:18 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbcd6b8f-1462-4341-9968-21f33b823ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f4daba6-fcaa-48dc-b01f-eaa328b1fe59', 'volume_name': 'volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:18 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6854204f-ae4f-4cb8-8611-81819cb6b2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:18 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6854204f-ae4f-4cb8-8611-81819cb6b2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:18 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eb2305a-32b7-4dc5-b387-b1a8f56574b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:18 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] Volume 7f4daba6-fcaa-48dc-b01f-eaa328b1fe59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59', 'volume_size': 1} Nov 03 13:29:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:29:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:29:18 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-28042677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f4daba6-fcaa-48dc-b01f-eaa328b1fe59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60ac3b296fa402ebc45563747540073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:29:19Z,use_quota=True,user_id='82e28082879940beb510c24ff3452f75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:29:18 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] Creating volume 7f4daba6-fcaa-48dc-b01f-eaa328b1fe59 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:29:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:29:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:29:18 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:29:18 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:29:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:29:18 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:29:18 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:29:18 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:18 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59 1073741824 Nov 03 13:29:18 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:19 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59 1073741824" returned: 0 in 0.459s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:19 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59 Nov 03 13:29:19 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:19 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59" returned: 0 in 0.267s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:19 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:29:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:29:19 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eb2305a-32b7-4dc5-b387-b1a8f56574b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:19 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a30991c5-b2d1-40e7-9159-7a16fcb119dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:19 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] Volume volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59 (7f4daba6-fcaa-48dc-b01f-eaa328b1fe59): created successfully Nov 03 13:29:19 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a30991c5-b2d1-40e7-9159-7a16fcb119dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:19 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] Flow 'volume_create_manager' (91115d7c-bf63-4076-9870-a36a9bd35aac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:29:19 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-60564f36-c3c5-4774-ae7d-46ba12ad22e5 tempest-ProjectMemberTests-1676407320 None] Created volume successfully. Nov 03 13:29:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ca5a56ad-c648-4d8e-bb64-f0fea6e26d3b tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:29:19 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ca5a56ad-c648-4d8e-bb64-f0fea6e26d3b tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:29:20 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-ca5a56ad-c648-4d8e-bb64-f0fea6e26d3b tempest-ProjectMemberTests-1676407320 None] Creating offline snapshot e325531f-c606-4440-b540-3f3dab6c4408 of volume 7f4daba6-fcaa-48dc-b01f-eaa328b1fe59 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:29:20 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d9ebca-124b-4895-9d2c-95f4df11dbe7]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:29:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ca5a56ad-c648-4d8e-bb64-f0fea6e26d3b tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:20 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59 Nov 03 13:29:20 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:20 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ca5a56ad-c648-4d8e-bb64-f0fea6e26d3b tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59" returned: 0 in 0.362s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ca5a56ad-c648-4d8e-bb64-f0fea6e26d3b tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59.e325531f-c606-4440-b540-3f3dab6c4408 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:20 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59.e325531f-c606-4440-b540-3f3dab6c4408 1G Nov 03 13:29:20 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:20 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ca5a56ad-c648-4d8e-bb64-f0fea6e26d3b tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59.e325531f-c606-4440-b540-3f3dab6c4408 1G" returned: 0 in 0.380s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:20 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ca5a56ad-c648-4d8e-bb64-f0fea6e26d3b tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59.e325531f-c606-4440-b540-3f3dab6c4408 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:20 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59.e325531f-c606-4440-b540-3f3dab6c4408 Nov 03 13:29:20 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:21 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ca5a56ad-c648-4d8e-bb64-f0fea6e26d3b tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59.e325531f-c606-4440-b540-3f3dab6c4408" returned: 0 in 0.308s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:21 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-ca5a56ad-c648-4d8e-bb64-f0fea6e26d3b tempest-ProjectMemberTests-1676407320 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59.e325531f-c606-4440-b540-3f3dab6c4408 is being set with open permissions: ugo+rw Nov 03 13:29:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ca5a56ad-c648-4d8e-bb64-f0fea6e26d3b tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59.e325531f-c606-4440-b540-3f3dab6c4408 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:21 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59.e325531f-c606-4440-b540-3f3dab6c4408 Nov 03 13:29:21 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:21 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ca5a56ad-c648-4d8e-bb64-f0fea6e26d3b tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59.e325531f-c606-4440-b540-3f3dab6c4408" returned: 0 in 0.242s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ca5a56ad-c648-4d8e-bb64-f0fea6e26d3b tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:21 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59.info Nov 03 13:29:21 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:21 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ca5a56ad-c648-4d8e-bb64-f0fea6e26d3b tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59.info" returned: 0 in 0.262s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:21 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-ca5a56ad-c648-4d8e-bb64-f0fea6e26d3b tempest-ProjectMemberTests-1676407320 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59.info is being set with open permissions: ugo+rw Nov 03 13:29:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ca5a56ad-c648-4d8e-bb64-f0fea6e26d3b tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:21 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59.info Nov 03 13:29:21 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:21 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-ca5a56ad-c648-4d8e-bb64-f0fea6e26d3b tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59.info" returned: 0 in 0.259s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:21 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-ca5a56ad-c648-4d8e-bb64-f0fea6e26d3b tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.897s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:29:21 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-ca5a56ad-c648-4d8e-bb64-f0fea6e26d3b tempest-ProjectMemberTests-1676407320 None] Create snapshot completed successfully Nov 03 13:29:22 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d22dca0b-fca3-41f2-a9a5-01bd89e786b9 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-e325531f-c606-4440-b540-3f3dab6c4408-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:22 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d22dca0b-fca3-41f2-a9a5-01bd89e786b9 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-e325531f-c606-4440-b540-3f3dab6c4408-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:22 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d22dca0b-fca3-41f2-a9a5-01bd89e786b9 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-quobyte-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:22 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d22dca0b-fca3-41f2-a9a5-01bd89e786b9 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:22 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d22dca0b-fca3-41f2-a9a5-01bd89e786b9 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-quobyte-e325531f-c606-4440-b540-3f3dab6c4408" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:23 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d22dca0b-fca3-41f2-a9a5-01bd89e786b9 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-e325531f-c606-4440-b540-3f3dab6c4408" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:23 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-d22dca0b-fca3-41f2-a9a5-01bd89e786b9 tempest-ProjectMemberTests-1676407320 None] Deleting offline snapshot e325531f-c606-4440-b540-3f3dab6c4408 of volume 7f4daba6-fcaa-48dc-b01f-eaa328b1fe59 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:29:23 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-d22dca0b-fca3-41f2-a9a5-01bd89e786b9 tempest-ProjectMemberTests-1676407320 None] snapshot_file for this snap is: volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59.e325531f-c606-4440-b540-3f3dab6c4408 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:29:23 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[798fb145-5064-4a3d-8896-b501c4a46f19]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:29:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d22dca0b-fca3-41f2-a9a5-01bd89e786b9 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59.e325531f-c606-4440-b540-3f3dab6c4408 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:23 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59.e325531f-c606-4440-b540-3f3dab6c4408 Nov 03 13:29:23 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:23 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d22dca0b-fca3-41f2-a9a5-01bd89e786b9 tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59.e325531f-c606-4440-b540-3f3dab6c4408" returned: 0 in 0.406s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:23 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-d22dca0b-fca3-41f2-a9a5-01bd89e786b9 tempest-ProjectMemberTests-1676407320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:29:23 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[c390d02c-73f1-4d20-8a6c-33c76ca232ad]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:29:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d22dca0b-fca3-41f2-a9a5-01bd89e786b9 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:23 devstack sudo[107822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59 Nov 03 13:29:23 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:23 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d22dca0b-fca3-41f2-a9a5-01bd89e786b9 tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59" returned: 0 in 0.377s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d22dca0b-fca3-41f2-a9a5-01bd89e786b9 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59.e325531f-c606-4440-b540-3f3dab6c4408 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:23 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59.e325531f-c606-4440-b540-3f3dab6c4408 Nov 03 13:29:23 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:24 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d22dca0b-fca3-41f2-a9a5-01bd89e786b9 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59.e325531f-c606-4440-b540-3f3dab6c4408" returned: 0 in 0.344s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d22dca0b-fca3-41f2-a9a5-01bd89e786b9 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59.e325531f-c606-4440-b540-3f3dab6c4408 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:24 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59.e325531f-c606-4440-b540-3f3dab6c4408 Nov 03 13:29:24 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:24 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d22dca0b-fca3-41f2-a9a5-01bd89e786b9 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59.e325531f-c606-4440-b540-3f3dab6c4408" returned: 0 in 0.251s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:24 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d22dca0b-fca3-41f2-a9a5-01bd89e786b9 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-e325531f-c606-4440-b540-3f3dab6c4408" released by "_delete_snapshot" :: held 1.486s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:24 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d22dca0b-fca3-41f2-a9a5-01bd89e786b9 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59" released by "delete_snapshot" :: held 1.514s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:24 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-d22dca0b-fca3-41f2-a9a5-01bd89e786b9 tempest-ProjectMemberTests-1676407320 None] Created reservations ['3bb9c58c-cff8-440d-9b2d-8eec33baaec1', '6f9c384f-a537-441a-9cae-5ca79d321658', '01218a25-90cc-4088-9fb3-f481eb69cf84', '6eb5ad46-838b-4e51-9e9c-70a9f4f2a68f'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:29:24 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-d22dca0b-fca3-41f2-a9a5-01bd89e786b9 tempest-ProjectMemberTests-1676407320 None] Delete snapshot completed successfully. Nov 03 13:29:24 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d22dca0b-fca3-41f2-a9a5-01bd89e786b9 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-e325531f-c606-4440-b540-3f3dab6c4408-delete_snapshot" released by "delete_snapshot" :: held 1.659s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:24 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:29:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] Flow 'volume_create_manager' (c9da56b4-d821-4b4b-bec5-85668baaeab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:29:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc0b958d-cc22-4743-82e6-f444855a690b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc0b958d-cc22-4743-82e6-f444855a690b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-48659740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0a8185d-ac00-41a4-8ddb-63065696a423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b618ef072541338105a1b383318bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:29:25Z,use_quota=True,user_id='2d6f6b7f15a6411bb0705749794490cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a03ee0-ff5e-4bf2-96ea-7cc43bc49656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a03ee0-ff5e-4bf2-96ea-7cc43bc49656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be72c96d-4fb1-4d43-aa94-722abe291768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be72c96d-4fb1-4d43-aa94-722abe291768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0a8185d-ac00-41a4-8ddb-63065696a423', 'volume_name': 'volume-e0a8185d-ac00-41a4-8ddb-63065696a423', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca6e8faf-1bdc-48dc-8c21-8c9f19b6e79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca6e8faf-1bdc-48dc-8c21-8c9f19b6e79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:24 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb21556-4a51-4e85-981d-0c7dd91dc91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:24 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] Volume e0a8185d-ac00-41a4-8ddb-63065696a423: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0a8185d-ac00-41a4-8ddb-63065696a423', 'volume_size': 1} Nov 03 13:29:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:29:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:29:24 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-48659740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0a8185d-ac00-41a4-8ddb-63065696a423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b618ef072541338105a1b383318bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:29:25Z,use_quota=True,user_id='2d6f6b7f15a6411bb0705749794490cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:29:24 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] Creating volume e0a8185d-ac00-41a4-8ddb-63065696a423 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:29:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:29:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:29:24 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:29:24 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:29:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:29:24 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:29:24 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:29:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e0a8185d-ac00-41a4-8ddb-63065696a423 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:24 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e0a8185d-ac00-41a4-8ddb-63065696a423 1073741824 Nov 03 13:29:24 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d2c4e2fb-98a9-48b3-a173-71942209e0ad tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d2c4e2fb-98a9-48b3-a173-71942209e0ad tempest-ProjectMemberTests-1676407320 None] Lock "cinder-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d2c4e2fb-98a9-48b3-a173-71942209e0ad tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-quobyte-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d2c4e2fb-98a9-48b3-a173-71942209e0ad tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59" acquired by "delete_volume" :: waited 0.014s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:25 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c60ffe-82a7-4529-b531-722e1a28dc9c]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:29:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d2c4e2fb-98a9-48b3-a173-71942209e0ad tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:25 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e0a8185d-ac00-41a4-8ddb-63065696a423 1073741824" returned: 0 in 0.447s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:25 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59 Nov 03 13:29:25 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e0a8185d-ac00-41a4-8ddb-63065696a423 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:25 devstack sudo[107842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e0a8185d-ac00-41a4-8ddb-63065696a423 Nov 03 13:29:25 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:25 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d2c4e2fb-98a9-48b3-a173-71942209e0ad tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59" returned: 0 in 0.369s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d2c4e2fb-98a9-48b3-a173-71942209e0ad tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:25 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e0a8185d-ac00-41a4-8ddb-63065696a423" returned: 0 in 0.247s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:29:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:29:25 devstack sudo[107848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59 Nov 03 13:29:25 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb21556-4a51-4e85-981d-0c7dd91dc91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0a8185d-ac00-41a4-8ddb-63065696a423', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89f568c4-22eb-4d3a-b68c-266fc35f4c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:25 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] Volume volume-e0a8185d-ac00-41a4-8ddb-63065696a423 (e0a8185d-ac00-41a4-8ddb-63065696a423): created successfully Nov 03 13:29:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89f568c4-22eb-4d3a-b68c-266fc35f4c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] Flow 'volume_create_manager' (c9da56b4-d821-4b4b-bec5-85668baaeab5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:29:25 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-c235370e-9a6a-4756-a262-c4158ed3f7fc tempest-ProjectReaderTests-512147010 None] Created volume successfully. Nov 03 13:29:25 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d2c4e2fb-98a9-48b3-a173-71942209e0ad tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59" returned: 0 in 0.268s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d2c4e2fb-98a9-48b3-a173-71942209e0ad tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59" released by "delete_volume" :: held 0.710s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:25 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-d2c4e2fb-98a9-48b3-a173-71942209e0ad tempest-ProjectMemberTests-1676407320 None] Created reservations ['63702f59-bd3f-4a50-a9c8-87345d00f087', '646afc05-0956-479d-a04a-ff8c1efcf592', 'faceabc9-7b5b-406b-bf3f-76d9d81651ab', '5ae3cbbe-a6e5-48cc-958d-d212da30f38b'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:29:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a2f48793-25d5-4adf-801e-f53117771346 tempest-ProjectReaderTests-512147010 None] Acquiring lock "cinder-e0a8185d-ac00-41a4-8ddb-63065696a423-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a2f48793-25d5-4adf-801e-f53117771346 tempest-ProjectReaderTests-512147010 None] Lock "cinder-e0a8185d-ac00-41a4-8ddb-63065696a423-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d2c4e2fb-98a9-48b3-a173-71942209e0ad tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d2c4e2fb-98a9-48b3-a173-71942209e0ad tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d2c4e2fb-98a9-48b3-a173-71942209e0ad tempest-ProjectMemberTests-1676407320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-d2c4e2fb-98a9-48b3-a173-71942209e0ad tempest-ProjectMemberTests-1676407320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-d2c4e2fb-98a9-48b3-a173-71942209e0ad tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d2c4e2fb-98a9-48b3-a173-71942209e0ad tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:26 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:29:26 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a2f48793-25d5-4adf-801e-f53117771346 tempest-ProjectReaderTests-512147010 None] Acquiring lock "cinder-quobyte-e0a8185d-ac00-41a4-8ddb-63065696a423" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a2f48793-25d5-4adf-801e-f53117771346 tempest-ProjectReaderTests-512147010 None] Lock "cinder-quobyte-e0a8185d-ac00-41a4-8ddb-63065696a423" acquired by "delete_volume" :: waited 0.018s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4dc5fa-4a72-45aa-bf4b-21b2e91e613c]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a2f48793-25d5-4adf-801e-f53117771346 tempest-ProjectReaderTests-512147010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e0a8185d-ac00-41a4-8ddb-63065696a423 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:26 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e0a8185d-ac00-41a4-8ddb-63065696a423 Nov 03 13:29:26 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:26 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-d2c4e2fb-98a9-48b3-a173-71942209e0ad tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.265s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-d2c4e2fb-98a9-48b3-a173-71942209e0ad tempest-ProjectMemberTests-1676407320 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:29:26 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-d2c4e2fb-98a9-48b3-a173-71942209e0ad tempest-ProjectMemberTests-1676407320 None] Deleted volume successfully. Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-d2c4e2fb-98a9-48b3-a173-71942209e0ad tempest-ProjectMemberTests-1676407320 None] Lock "cinder-7f4daba6-fcaa-48dc-b01f-eaa328b1fe59-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:26 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a2f48793-25d5-4adf-801e-f53117771346 tempest-ProjectReaderTests-512147010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e0a8185d-ac00-41a4-8ddb-63065696a423" returned: 0 in 0.389s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a2f48793-25d5-4adf-801e-f53117771346 tempest-ProjectReaderTests-512147010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e0a8185d-ac00-41a4-8ddb-63065696a423 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:26 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e0a8185d-ac00-41a4-8ddb-63065696a423 Nov 03 13:29:26 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:29:26 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] Flow 'volume_create_manager' (8d13873c-1f1c-467a-bc61-d583ea2ccf1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (047139e1-1c10-4bae-8c4e-71989b992c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a2f48793-25d5-4adf-801e-f53117771346 tempest-ProjectReaderTests-512147010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-e0a8185d-ac00-41a4-8ddb-63065696a423" returned: 0 in 0.286s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (047139e1-1c10-4bae-8c4e-71989b992c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1320615141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa73cbdf-9159-46f0-9121-f61cdd20cae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60ac3b296fa402ebc45563747540073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:29:27Z,use_quota=True,user_id='82e28082879940beb510c24ff3452f75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e089691-4088-4542-ba60-f52427f06157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e089691-4088-4542-ba60-f52427f06157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2766cd-bb75-4f99-9a47-52cbec26399a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2766cd-bb75-4f99-9a47-52cbec26399a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa73cbdf-9159-46f0-9121-f61cdd20cae0', 'volume_name': 'volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c13df3-18eb-4842-9791-6787c4c58aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c13df3-18eb-4842-9791-6787c4c58aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88334959-c656-46c8-8703-7cf19bc508de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:26 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] Volume aa73cbdf-9159-46f0-9121-f61cdd20cae0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0', 'volume_size': 1} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1320615141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa73cbdf-9159-46f0-9121-f61cdd20cae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60ac3b296fa402ebc45563747540073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:29:27Z,use_quota=True,user_id='82e28082879940beb510c24ff3452f75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] Creating volume aa73cbdf-9159-46f0-9121-f61cdd20cae0 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:29:26 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a2f48793-25d5-4adf-801e-f53117771346 tempest-ProjectReaderTests-512147010 None] Lock "cinder-quobyte-e0a8185d-ac00-41a4-8ddb-63065696a423" released by "delete_volume" :: held 0.778s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:26 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0 1073741824 Nov 03 13:29:26 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-a2f48793-25d5-4adf-801e-f53117771346 tempest-ProjectReaderTests-512147010 None] Created reservations ['fb2ef25f-d6ef-4df0-a5c0-28806d59458b', '7a544aa1-b2d9-450d-8170-56f9fb3cfb59', 'd9f76769-9272-450e-99a9-adaa252edf9b', 'cbb435d6-8a2d-4f5d-b9be-0f4e9449bf48'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a2f48793-25d5-4adf-801e-f53117771346 tempest-ProjectReaderTests-512147010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a2f48793-25d5-4adf-801e-f53117771346 tempest-ProjectReaderTests-512147010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a2f48793-25d5-4adf-801e-f53117771346 tempest-ProjectReaderTests-512147010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-a2f48793-25d5-4adf-801e-f53117771346 tempest-ProjectReaderTests-512147010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-a2f48793-25d5-4adf-801e-f53117771346 tempest-ProjectReaderTests-512147010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:29:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a2f48793-25d5-4adf-801e-f53117771346 tempest-ProjectReaderTests-512147010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:26 devstack sudo[107866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:29:26 devstack sudo[107866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:27 devstack sudo[107866]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-a2f48793-25d5-4adf-801e-f53117771346 tempest-ProjectReaderTests-512147010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.271s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:27 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-a2f48793-25d5-4adf-801e-f53117771346 tempest-ProjectReaderTests-512147010 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:29:27 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-a2f48793-25d5-4adf-801e-f53117771346 tempest-ProjectReaderTests-512147010 None] Deleted volume successfully. Nov 03 13:29:27 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-a2f48793-25d5-4adf-801e-f53117771346 tempest-ProjectReaderTests-512147010 None] Lock "cinder-e0a8185d-ac00-41a4-8ddb-63065696a423-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:27 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0 1073741824" returned: 0 in 0.495s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:27 devstack sudo[107873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0 Nov 03 13:29:27 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:27 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:29:27 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] Flow 'volume_create_manager' (1d746be4-becf-45f8-be48-64a8c99fbcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:29:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c114e26f-97c4-450e-9b86-831692027532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0" returned: 0 in 0.293s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:27 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:29:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:29:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c114e26f-97c4-450e-9b86-831692027532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1585648813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576cfd13-9ec9-4793-a26e-a59473a577fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b618ef072541338105a1b383318bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:29:28Z,use_quota=True,user_id='2d6f6b7f15a6411bb0705749794490cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0a01776-6331-4d81-b99f-f6598f9d9fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0a01776-6331-4d81-b99f-f6598f9d9fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (925bb84a-d511-45e7-8370-27454048f998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (925bb84a-d511-45e7-8370-27454048f998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '576cfd13-9ec9-4793-a26e-a59473a577fb', 'volume_name': 'volume-576cfd13-9ec9-4793-a26e-a59473a577fb', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (845ba6a0-3279-4286-9230-b90f3f8cc7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (845ba6a0-3279-4286-9230-b90f3f8cc7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7afc30b-c673-4a2d-bed1-43d21d6f4b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:27 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] Volume 576cfd13-9ec9-4793-a26e-a59473a577fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-576cfd13-9ec9-4793-a26e-a59473a577fb', 'volume_size': 1} Nov 03 13:29:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:29:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:29:27 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1585648813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576cfd13-9ec9-4793-a26e-a59473a577fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b618ef072541338105a1b383318bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:29:28Z,use_quota=True,user_id='2d6f6b7f15a6411bb0705749794490cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:29:27 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] Creating volume 576cfd13-9ec9-4793-a26e-a59473a577fb {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:29:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:29:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:29:27 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:29:27 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:29:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:29:27 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:29:27 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:29:27 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-576cfd13-9ec9-4793-a26e-a59473a577fb 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88334959-c656-46c8-8703-7cf19bc508de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca7069f-3c9b-4bd0-ba6b-9333b5f405fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:27 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-576cfd13-9ec9-4793-a26e-a59473a577fb 1073741824 Nov 03 13:29:27 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:27 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] Volume volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0 (aa73cbdf-9159-46f0-9121-f61cdd20cae0): created successfully Nov 03 13:29:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca7069f-3c9b-4bd0-ba6b-9333b5f405fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:27 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] Flow 'volume_create_manager' (8d13873c-1f1c-467a-bc61-d583ea2ccf1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:29:27 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-37b2cabd-059b-4800-9a40-d075de028463 tempest-ProjectMemberTests-1676407320 None] Created volume successfully. Nov 03 13:29:28 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-576cfd13-9ec9-4793-a26e-a59473a577fb 1073741824" returned: 0 in 0.418s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-576cfd13-9ec9-4793-a26e-a59473a577fb {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:28 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-576cfd13-9ec9-4793-a26e-a59473a577fb Nov 03 13:29:28 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:28 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-576cfd13-9ec9-4793-a26e-a59473a577fb" returned: 0 in 0.240s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:28 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:29:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:29:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7afc30b-c673-4a2d-bed1-43d21d6f4b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-576cfd13-9ec9-4793-a26e-a59473a577fb', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f617ddc-340b-47f4-957f-f77b5aa98094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:28 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] Volume volume-576cfd13-9ec9-4793-a26e-a59473a577fb (576cfd13-9ec9-4793-a26e-a59473a577fb): created successfully Nov 03 13:29:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f617ddc-340b-47f4-957f-f77b5aa98094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:28 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] Flow 'volume_create_manager' (1d746be4-becf-45f8-be48-64a8c99fbcb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:29:28 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-8e1e787b-3871-4317-860b-b2e38667e723 tempest-ProjectReaderTests-512147010 None] Created volume successfully. Nov 03 13:29:28 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-10b7acb0-2232-4050-b385-44e13001691b tempest-ProjectReaderTests-512147010 None] Acquiring lock "cinder-576cfd13-9ec9-4793-a26e-a59473a577fb-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:28 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-10b7acb0-2232-4050-b385-44e13001691b tempest-ProjectReaderTests-512147010 None] Lock "cinder-576cfd13-9ec9-4793-a26e-a59473a577fb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:28 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-10b7acb0-2232-4050-b385-44e13001691b tempest-ProjectReaderTests-512147010 None] Acquiring lock "cinder-quobyte-576cfd13-9ec9-4793-a26e-a59473a577fb" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:28 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-10b7acb0-2232-4050-b385-44e13001691b tempest-ProjectReaderTests-512147010 None] Lock "cinder-quobyte-576cfd13-9ec9-4793-a26e-a59473a577fb" acquired by "delete_volume" :: waited 0.019s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:28 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9aa077-3615-46db-bb42-8fab266bbcc8]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:29:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-10b7acb0-2232-4050-b385-44e13001691b tempest-ProjectReaderTests-512147010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-576cfd13-9ec9-4793-a26e-a59473a577fb {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:28 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-576cfd13-9ec9-4793-a26e-a59473a577fb Nov 03 13:29:28 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5de8ae1e-63a9-457c-ba79-098f0fef22fb tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:29:28 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5de8ae1e-63a9-457c-ba79-098f0fef22fb tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:29:28 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-5de8ae1e-63a9-457c-ba79-098f0fef22fb tempest-ProjectMemberTests-1676407320 None] Creating offline snapshot cd5bd384-43cb-484c-80e1-056a43ed59b7 of volume aa73cbdf-9159-46f0-9121-f61cdd20cae0 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:29:29 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ab2148-3c65-4a3a-bc18-835541296992]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:29:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5de8ae1e-63a9-457c-ba79-098f0fef22fb tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:29 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0 Nov 03 13:29:29 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:29 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-10b7acb0-2232-4050-b385-44e13001691b tempest-ProjectReaderTests-512147010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-576cfd13-9ec9-4793-a26e-a59473a577fb" returned: 0 in 0.383s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-10b7acb0-2232-4050-b385-44e13001691b tempest-ProjectReaderTests-512147010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-576cfd13-9ec9-4793-a26e-a59473a577fb {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:29 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-576cfd13-9ec9-4793-a26e-a59473a577fb Nov 03 13:29:29 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:29 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5de8ae1e-63a9-457c-ba79-098f0fef22fb tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0" returned: 0 in 0.374s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5de8ae1e-63a9-457c-ba79-098f0fef22fb tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0.cd5bd384-43cb-484c-80e1-056a43ed59b7 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:29 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-10b7acb0-2232-4050-b385-44e13001691b tempest-ProjectReaderTests-512147010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-576cfd13-9ec9-4793-a26e-a59473a577fb" returned: 0 in 0.266s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:29 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0.cd5bd384-43cb-484c-80e1-056a43ed59b7 1G Nov 03 13:29:29 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:29 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-10b7acb0-2232-4050-b385-44e13001691b tempest-ProjectReaderTests-512147010 None] Lock "cinder-quobyte-576cfd13-9ec9-4793-a26e-a59473a577fb" released by "delete_volume" :: held 0.699s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:29 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-10b7acb0-2232-4050-b385-44e13001691b tempest-ProjectReaderTests-512147010 None] Created reservations ['13cd1d9a-f8bb-4adf-8839-a403202b0039', '7c55e0e7-510c-4b40-95df-6539e28e7ff4', '88c57783-40a3-4bb9-993a-dc4b208f09a9', '070531a5-f05e-43e6-9531-047b30409b84'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:29:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-10b7acb0-2232-4050-b385-44e13001691b tempest-ProjectReaderTests-512147010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:29:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-10b7acb0-2232-4050-b385-44e13001691b tempest-ProjectReaderTests-512147010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:29:29 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-10b7acb0-2232-4050-b385-44e13001691b tempest-ProjectReaderTests-512147010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:29:29 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-10b7acb0-2232-4050-b385-44e13001691b tempest-ProjectReaderTests-512147010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:29:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-10b7acb0-2232-4050-b385-44e13001691b tempest-ProjectReaderTests-512147010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:29:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-10b7acb0-2232-4050-b385-44e13001691b tempest-ProjectReaderTests-512147010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:29 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:29:29 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:29 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-10b7acb0-2232-4050-b385-44e13001691b tempest-ProjectReaderTests-512147010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.297s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:29 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-10b7acb0-2232-4050-b385-44e13001691b tempest-ProjectReaderTests-512147010 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:29:29 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-10b7acb0-2232-4050-b385-44e13001691b tempest-ProjectReaderTests-512147010 None] Deleted volume successfully. Nov 03 13:29:29 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5de8ae1e-63a9-457c-ba79-098f0fef22fb tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0.cd5bd384-43cb-484c-80e1-056a43ed59b7 1G" returned: 0 in 0.477s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:29 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5de8ae1e-63a9-457c-ba79-098f0fef22fb tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0.cd5bd384-43cb-484c-80e1-056a43ed59b7 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:29 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-10b7acb0-2232-4050-b385-44e13001691b tempest-ProjectReaderTests-512147010 None] Lock "cinder-576cfd13-9ec9-4793-a26e-a59473a577fb-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:29 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0.cd5bd384-43cb-484c-80e1-056a43ed59b7 Nov 03 13:29:29 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:30 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5de8ae1e-63a9-457c-ba79-098f0fef22fb tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0.cd5bd384-43cb-484c-80e1-056a43ed59b7" returned: 0 in 0.310s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:30 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-5de8ae1e-63a9-457c-ba79-098f0fef22fb tempest-ProjectMemberTests-1676407320 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0.cd5bd384-43cb-484c-80e1-056a43ed59b7 is being set with open permissions: ugo+rw Nov 03 13:29:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5de8ae1e-63a9-457c-ba79-098f0fef22fb tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0.cd5bd384-43cb-484c-80e1-056a43ed59b7 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:30 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0.cd5bd384-43cb-484c-80e1-056a43ed59b7 Nov 03 13:29:30 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:30 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5de8ae1e-63a9-457c-ba79-098f0fef22fb tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0.cd5bd384-43cb-484c-80e1-056a43ed59b7" returned: 0 in 0.269s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5de8ae1e-63a9-457c-ba79-098f0fef22fb tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:30 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0.info Nov 03 13:29:30 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:30 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5de8ae1e-63a9-457c-ba79-098f0fef22fb tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0.info" returned: 0 in 0.261s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:30 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-5de8ae1e-63a9-457c-ba79-098f0fef22fb tempest-ProjectMemberTests-1676407320 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0.info is being set with open permissions: ugo+rw Nov 03 13:29:30 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5de8ae1e-63a9-457c-ba79-098f0fef22fb tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:30 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0.info Nov 03 13:29:30 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:30 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-5de8ae1e-63a9-457c-ba79-098f0fef22fb tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0.info" returned: 0 in 0.257s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:31 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-5de8ae1e-63a9-457c-ba79-098f0fef22fb tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.044s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:29:31 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-5de8ae1e-63a9-457c-ba79-098f0fef22fb tempest-ProjectMemberTests-1676407320 None] Create snapshot completed successfully Nov 03 13:29:32 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8f29020d-2e27-4abd-92c8-3041a1f82b0c tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-cd5bd384-43cb-484c-80e1-056a43ed59b7-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:32 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8f29020d-2e27-4abd-92c8-3041a1f82b0c tempest-ProjectMemberTests-1676407320 None] Lock "cinder-cd5bd384-43cb-484c-80e1-056a43ed59b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:32 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8f29020d-2e27-4abd-92c8-3041a1f82b0c tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-quobyte-aa73cbdf-9159-46f0-9121-f61cdd20cae0" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:32 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8f29020d-2e27-4abd-92c8-3041a1f82b0c tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-aa73cbdf-9159-46f0-9121-f61cdd20cae0" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:32 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8f29020d-2e27-4abd-92c8-3041a1f82b0c tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-quobyte-cd5bd384-43cb-484c-80e1-056a43ed59b7" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:32 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8f29020d-2e27-4abd-92c8-3041a1f82b0c tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-cd5bd384-43cb-484c-80e1-056a43ed59b7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:32 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-8f29020d-2e27-4abd-92c8-3041a1f82b0c tempest-ProjectMemberTests-1676407320 None] Deleting offline snapshot cd5bd384-43cb-484c-80e1-056a43ed59b7 of volume aa73cbdf-9159-46f0-9121-f61cdd20cae0 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:29:32 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-8f29020d-2e27-4abd-92c8-3041a1f82b0c tempest-ProjectMemberTests-1676407320 None] snapshot_file for this snap is: volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0.cd5bd384-43cb-484c-80e1-056a43ed59b7 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:29:32 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd031d2-a0b9-4d7e-81aa-72485eb6eae2]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:29:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8f29020d-2e27-4abd-92c8-3041a1f82b0c tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0.cd5bd384-43cb-484c-80e1-056a43ed59b7 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:32 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0.cd5bd384-43cb-484c-80e1-056a43ed59b7 Nov 03 13:29:32 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:32 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8f29020d-2e27-4abd-92c8-3041a1f82b0c tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0.cd5bd384-43cb-484c-80e1-056a43ed59b7" returned: 0 in 0.371s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:32 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-8f29020d-2e27-4abd-92c8-3041a1f82b0c tempest-ProjectMemberTests-1676407320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:29:32 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9531564-4896-4dcd-925c-af11d22b63d4]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:29:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8f29020d-2e27-4abd-92c8-3041a1f82b0c tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:32 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0 Nov 03 13:29:32 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:33 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8f29020d-2e27-4abd-92c8-3041a1f82b0c tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0" returned: 0 in 0.396s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8f29020d-2e27-4abd-92c8-3041a1f82b0c tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0.cd5bd384-43cb-484c-80e1-056a43ed59b7 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:33 devstack sudo[107930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0.cd5bd384-43cb-484c-80e1-056a43ed59b7 Nov 03 13:29:33 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:33 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8f29020d-2e27-4abd-92c8-3041a1f82b0c tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0.cd5bd384-43cb-484c-80e1-056a43ed59b7" returned: 0 in 0.370s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8f29020d-2e27-4abd-92c8-3041a1f82b0c tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0.cd5bd384-43cb-484c-80e1-056a43ed59b7 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:33 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0.cd5bd384-43cb-484c-80e1-056a43ed59b7 Nov 03 13:29:33 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:33 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8f29020d-2e27-4abd-92c8-3041a1f82b0c tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0.cd5bd384-43cb-484c-80e1-056a43ed59b7" returned: 0 in 0.255s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:33 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8f29020d-2e27-4abd-92c8-3041a1f82b0c tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-cd5bd384-43cb-484c-80e1-056a43ed59b7" released by "_delete_snapshot" :: held 1.505s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:33 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8f29020d-2e27-4abd-92c8-3041a1f82b0c tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-aa73cbdf-9159-46f0-9121-f61cdd20cae0" released by "delete_snapshot" :: held 1.529s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:33 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=209,cinder:INSERT=75,cinder:UPDATE=279,cinder:DELETE=25 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:29:33 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:INSERT=78,cinder:UPDATE=268,cinder:SELECT=205,cinder:DELETE=21 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:29:33 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-8f29020d-2e27-4abd-92c8-3041a1f82b0c tempest-ProjectMemberTests-1676407320 None] Created reservations ['00081a4a-fd5d-4029-80af-ee1ec620dc1c', '6582cbe0-4b65-4226-8a57-a76c7a4eadbb', 'aafcb80b-1d23-4bba-bfcb-72e1ac0d752b', '0e33f4fb-b821-480b-b3a4-99b01dee8a89'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:29:33 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-8f29020d-2e27-4abd-92c8-3041a1f82b0c tempest-ProjectMemberTests-1676407320 None] Delete snapshot completed successfully. Nov 03 13:29:33 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8f29020d-2e27-4abd-92c8-3041a1f82b0c tempest-ProjectMemberTests-1676407320 None] Lock "cinder-cd5bd384-43cb-484c-80e1-056a43ed59b7-delete_snapshot" released by "delete_snapshot" :: held 1.689s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:34 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8673a700-e77c-4583-83b9-3b27826c8bb0 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-aa73cbdf-9159-46f0-9121-f61cdd20cae0-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:34 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8673a700-e77c-4583-83b9-3b27826c8bb0 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-aa73cbdf-9159-46f0-9121-f61cdd20cae0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:34 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8673a700-e77c-4583-83b9-3b27826c8bb0 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-quobyte-aa73cbdf-9159-46f0-9121-f61cdd20cae0" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:34 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8673a700-e77c-4583-83b9-3b27826c8bb0 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-aa73cbdf-9159-46f0-9121-f61cdd20cae0" acquired by "delete_volume" :: waited 0.019s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:34 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6916706-c809-4bdb-b233-3797254f2847]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:29:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8673a700-e77c-4583-83b9-3b27826c8bb0 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:34 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0 Nov 03 13:29:34 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:34 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8673a700-e77c-4583-83b9-3b27826c8bb0 tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0" returned: 0 in 0.380s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8673a700-e77c-4583-83b9-3b27826c8bb0 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:34 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0 Nov 03 13:29:34 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:35 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8673a700-e77c-4583-83b9-3b27826c8bb0 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-aa73cbdf-9159-46f0-9121-f61cdd20cae0" returned: 0 in 0.277s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8673a700-e77c-4583-83b9-3b27826c8bb0 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-aa73cbdf-9159-46f0-9121-f61cdd20cae0" released by "delete_volume" :: held 0.728s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:35 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-8673a700-e77c-4583-83b9-3b27826c8bb0 tempest-ProjectMemberTests-1676407320 None] Created reservations ['2b9126cf-1f4d-4b7b-9578-9cdc39bb31fb', 'b3757a30-8276-4abf-938d-4b410c8d083f', '284e71b0-9326-480b-b578-11911f9b6f5e', '78bdd99c-4e01-460f-a93f-dad423dce371'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:29:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8673a700-e77c-4583-83b9-3b27826c8bb0 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:29:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8673a700-e77c-4583-83b9-3b27826c8bb0 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:29:35 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-8673a700-e77c-4583-83b9-3b27826c8bb0 tempest-ProjectMemberTests-1676407320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:29:35 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-8673a700-e77c-4583-83b9-3b27826c8bb0 tempest-ProjectMemberTests-1676407320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:29:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-8673a700-e77c-4583-83b9-3b27826c8bb0 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:29:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8673a700-e77c-4583-83b9-3b27826c8bb0 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:35 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:29:35 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:35 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-8673a700-e77c-4583-83b9-3b27826c8bb0 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.313s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:35 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-8673a700-e77c-4583-83b9-3b27826c8bb0 tempest-ProjectMemberTests-1676407320 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:29:35 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-8673a700-e77c-4583-83b9-3b27826c8bb0 tempest-ProjectMemberTests-1676407320 None] Deleted volume successfully. Nov 03 13:29:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-8673a700-e77c-4583-83b9-3b27826c8bb0 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-aa73cbdf-9159-46f0-9121-f61cdd20cae0-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:36 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:29:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] Flow 'volume_create_manager' (ef465ab6-f8ce-48c6-bd8b-936bad2250d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:29:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d74e88-3148-49de-9aeb-484fe0f29294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d74e88-3148-49de-9aeb-484fe0f29294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-303901368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad2549cd-7d7e-422e-8200-26ce78fe7256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60ac3b296fa402ebc45563747540073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:29:36Z,use_quota=True,user_id='82e28082879940beb510c24ff3452f75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ab846c5-d5a4-4f3f-b376-31d90a86ec73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ab846c5-d5a4-4f3f-b376-31d90a86ec73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5d5aa5f-ef05-4f84-b801-2fd0a126647e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5d5aa5f-ef05-4f84-b801-2fd0a126647e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad2549cd-7d7e-422e-8200-26ce78fe7256', 'volume_name': 'volume-ad2549cd-7d7e-422e-8200-26ce78fe7256', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f52adf-53ad-418c-ac0a-3e92814cb872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f52adf-53ad-418c-ac0a-3e92814cb872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87bebfe4-ff1b-482c-a084-cd0cb3004e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:36 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] Volume ad2549cd-7d7e-422e-8200-26ce78fe7256: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad2549cd-7d7e-422e-8200-26ce78fe7256', 'volume_size': 1} Nov 03 13:29:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:29:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:29:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-303901368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad2549cd-7d7e-422e-8200-26ce78fe7256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60ac3b296fa402ebc45563747540073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:29:36Z,use_quota=True,user_id='82e28082879940beb510c24ff3452f75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:29:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] Creating volume ad2549cd-7d7e-422e-8200-26ce78fe7256 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:29:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:29:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:29:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:29:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:29:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:29:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:29:36 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:29:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:36 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256 1073741824 Nov 03 13:29:36 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:36 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256 1073741824" returned: 0 in 0.418s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:36 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256 Nov 03 13:29:36 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:36 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256" returned: 0 in 0.248s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:29:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:29:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87bebfe4-ff1b-482c-a084-cd0cb3004e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad2549cd-7d7e-422e-8200-26ce78fe7256', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da276345-9549-4924-9660-2ac8f383d328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:29:36 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] Volume volume-ad2549cd-7d7e-422e-8200-26ce78fe7256 (ad2549cd-7d7e-422e-8200-26ce78fe7256): created successfully Nov 03 13:29:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da276345-9549-4924-9660-2ac8f383d328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:29:36 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] Flow 'volume_create_manager' (ef465ab6-f8ce-48c6-bd8b-936bad2250d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:29:36 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-150a2dab-4f6f-46f4-aa4f-8d3afb882f84 tempest-ProjectMemberTests-1676407320 None] Created volume successfully. Nov 03 13:29:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-14193984-d549-4d81-9e49-c5ba7eaae83d tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:29:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-14193984-d549-4d81-9e49-c5ba7eaae83d tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:29:37 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-14193984-d549-4d81-9e49-c5ba7eaae83d tempest-ProjectMemberTests-1676407320 None] Creating offline snapshot 07fd67ce-4aa3-4bc1-95e3-a4d2531463c3 of volume ad2549cd-7d7e-422e-8200-26ce78fe7256 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:29:37 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9e30e2-6fb9-4584-8f7b-2eeb87cf3f9b]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:29:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-14193984-d549-4d81-9e49-c5ba7eaae83d tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:37 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256 Nov 03 13:29:37 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:37 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-14193984-d549-4d81-9e49-c5ba7eaae83d tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256" returned: 0 in 0.345s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-14193984-d549-4d81-9e49-c5ba7eaae83d tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256.07fd67ce-4aa3-4bc1-95e3-a4d2531463c3 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:37 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256.07fd67ce-4aa3-4bc1-95e3-a4d2531463c3 1G Nov 03 13:29:37 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:37 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-14193984-d549-4d81-9e49-c5ba7eaae83d tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256.07fd67ce-4aa3-4bc1-95e3-a4d2531463c3 1G" returned: 0 in 0.373s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-14193984-d549-4d81-9e49-c5ba7eaae83d tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad2549cd-7d7e-422e-8200-26ce78fe7256 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256.07fd67ce-4aa3-4bc1-95e3-a4d2531463c3 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:37 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad2549cd-7d7e-422e-8200-26ce78fe7256 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256.07fd67ce-4aa3-4bc1-95e3-a4d2531463c3 Nov 03 13:29:37 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:38 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-14193984-d549-4d81-9e49-c5ba7eaae83d tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad2549cd-7d7e-422e-8200-26ce78fe7256 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256.07fd67ce-4aa3-4bc1-95e3-a4d2531463c3" returned: 0 in 0.284s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:38 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-14193984-d549-4d81-9e49-c5ba7eaae83d tempest-ProjectMemberTests-1676407320 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256.07fd67ce-4aa3-4bc1-95e3-a4d2531463c3 is being set with open permissions: ugo+rw Nov 03 13:29:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-14193984-d549-4d81-9e49-c5ba7eaae83d tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256.07fd67ce-4aa3-4bc1-95e3-a4d2531463c3 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:38 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256.07fd67ce-4aa3-4bc1-95e3-a4d2531463c3 Nov 03 13:29:38 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:38 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-14193984-d549-4d81-9e49-c5ba7eaae83d tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256.07fd67ce-4aa3-4bc1-95e3-a4d2531463c3" returned: 0 in 0.233s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-14193984-d549-4d81-9e49-c5ba7eaae83d tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:38 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256.info Nov 03 13:29:38 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:38 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-14193984-d549-4d81-9e49-c5ba7eaae83d tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256.info" returned: 0 in 0.252s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:38 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-14193984-d549-4d81-9e49-c5ba7eaae83d tempest-ProjectMemberTests-1676407320 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256.info is being set with open permissions: ugo+rw Nov 03 13:29:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-14193984-d549-4d81-9e49-c5ba7eaae83d tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:38 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256.info Nov 03 13:29:38 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:38 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-14193984-d549-4d81-9e49-c5ba7eaae83d tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256.info" returned: 0 in 0.240s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:38 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-14193984-d549-4d81-9e49-c5ba7eaae83d tempest-ProjectMemberTests-1676407320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.804s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:29:38 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-14193984-d549-4d81-9e49-c5ba7eaae83d tempest-ProjectMemberTests-1676407320 None] Create snapshot completed successfully Nov 03 13:29:39 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c25dbae1-0fca-40b7-afff-2c83c50125e1 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-07fd67ce-4aa3-4bc1-95e3-a4d2531463c3-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:39 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c25dbae1-0fca-40b7-afff-2c83c50125e1 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-07fd67ce-4aa3-4bc1-95e3-a4d2531463c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:39 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c25dbae1-0fca-40b7-afff-2c83c50125e1 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-quobyte-ad2549cd-7d7e-422e-8200-26ce78fe7256" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:39 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c25dbae1-0fca-40b7-afff-2c83c50125e1 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-ad2549cd-7d7e-422e-8200-26ce78fe7256" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:39 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c25dbae1-0fca-40b7-afff-2c83c50125e1 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-quobyte-07fd67ce-4aa3-4bc1-95e3-a4d2531463c3" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:39 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c25dbae1-0fca-40b7-afff-2c83c50125e1 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-07fd67ce-4aa3-4bc1-95e3-a4d2531463c3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:39 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-c25dbae1-0fca-40b7-afff-2c83c50125e1 tempest-ProjectMemberTests-1676407320 None] Deleting offline snapshot 07fd67ce-4aa3-4bc1-95e3-a4d2531463c3 of volume ad2549cd-7d7e-422e-8200-26ce78fe7256 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:29:39 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-c25dbae1-0fca-40b7-afff-2c83c50125e1 tempest-ProjectMemberTests-1676407320 None] snapshot_file for this snap is: volume-ad2549cd-7d7e-422e-8200-26ce78fe7256.07fd67ce-4aa3-4bc1-95e3-a4d2531463c3 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:29:39 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3071651-0684-46fd-a601-9d8e496ae379]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:29:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c25dbae1-0fca-40b7-afff-2c83c50125e1 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256.07fd67ce-4aa3-4bc1-95e3-a4d2531463c3 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:39 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256.07fd67ce-4aa3-4bc1-95e3-a4d2531463c3 Nov 03 13:29:39 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:39 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c25dbae1-0fca-40b7-afff-2c83c50125e1 tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256.07fd67ce-4aa3-4bc1-95e3-a4d2531463c3" returned: 0 in 0.354s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:39 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-c25dbae1-0fca-40b7-afff-2c83c50125e1 tempest-ProjectMemberTests-1676407320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad2549cd-7d7e-422e-8200-26ce78fe7256(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:29:39 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[3013684d-2282-406a-9c51-16046a7d2510]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:29:39 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c25dbae1-0fca-40b7-afff-2c83c50125e1 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:39 devstack sudo[107990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256 Nov 03 13:29:39 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:40 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c25dbae1-0fca-40b7-afff-2c83c50125e1 tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256" returned: 0 in 0.358s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c25dbae1-0fca-40b7-afff-2c83c50125e1 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256.07fd67ce-4aa3-4bc1-95e3-a4d2531463c3 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:40 devstack sudo[107995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256.07fd67ce-4aa3-4bc1-95e3-a4d2531463c3 Nov 03 13:29:40 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:40 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c25dbae1-0fca-40b7-afff-2c83c50125e1 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256.07fd67ce-4aa3-4bc1-95e3-a4d2531463c3" returned: 0 in 0.335s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c25dbae1-0fca-40b7-afff-2c83c50125e1 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256.07fd67ce-4aa3-4bc1-95e3-a4d2531463c3 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:40 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256.07fd67ce-4aa3-4bc1-95e3-a4d2531463c3 Nov 03 13:29:40 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:40 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:40 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-c25dbae1-0fca-40b7-afff-2c83c50125e1 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256.07fd67ce-4aa3-4bc1-95e3-a4d2531463c3" returned: 0 in 0.242s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:40 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c25dbae1-0fca-40b7-afff-2c83c50125e1 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-07fd67ce-4aa3-4bc1-95e3-a4d2531463c3" released by "_delete_snapshot" :: held 1.382s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:40 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c25dbae1-0fca-40b7-afff-2c83c50125e1 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-ad2549cd-7d7e-422e-8200-26ce78fe7256" released by "delete_snapshot" :: held 1.404s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:40 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-c25dbae1-0fca-40b7-afff-2c83c50125e1 tempest-ProjectMemberTests-1676407320 None] Created reservations ['f72d558b-fc46-446d-9b53-52590d37735f', '460b207b-b8b1-4045-84f0-f29d0e46bdcd', '7becdb6b-2691-4d70-8496-b37f5cc0ec66', '7e4116ed-1328-4f93-995a-647341a8342b'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:29:40 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-c25dbae1-0fca-40b7-afff-2c83c50125e1 tempest-ProjectMemberTests-1676407320 None] Delete snapshot completed successfully. Nov 03 13:29:40 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-c25dbae1-0fca-40b7-afff-2c83c50125e1 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-07fd67ce-4aa3-4bc1-95e3-a4d2531463c3-delete_snapshot" released by "delete_snapshot" :: held 1.527s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:41 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0d045351-951b-4010-ad14-ff538e4158c0 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-ad2549cd-7d7e-422e-8200-26ce78fe7256-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:41 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0d045351-951b-4010-ad14-ff538e4158c0 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-ad2549cd-7d7e-422e-8200-26ce78fe7256-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:41 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0d045351-951b-4010-ad14-ff538e4158c0 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "cinder-quobyte-ad2549cd-7d7e-422e-8200-26ce78fe7256" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:29:41 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0d045351-951b-4010-ad14-ff538e4158c0 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-ad2549cd-7d7e-422e-8200-26ce78fe7256" acquired by "delete_volume" :: waited 0.014s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:29:41 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fef0461-0205-4f2f-9a25-78e57da5fb0e]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:29:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0d045351-951b-4010-ad14-ff538e4158c0 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:41 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256 Nov 03 13:29:41 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:41 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0d045351-951b-4010-ad14-ff538e4158c0 tempest-ProjectMemberTests-1676407320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256" returned: 0 in 0.349s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:41 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0d045351-951b-4010-ad14-ff538e4158c0 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:41 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256 Nov 03 13:29:41 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:42 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0d045351-951b-4010-ad14-ff538e4158c0 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-ad2549cd-7d7e-422e-8200-26ce78fe7256" returned: 0 in 0.242s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:42 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0d045351-951b-4010-ad14-ff538e4158c0 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-quobyte-ad2549cd-7d7e-422e-8200-26ce78fe7256" released by "delete_volume" :: held 0.653s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:42 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-0d045351-951b-4010-ad14-ff538e4158c0 tempest-ProjectMemberTests-1676407320 None] Created reservations ['ff6c8a64-c04f-400c-acd6-9bbb66f6898c', 'ae8636d5-498b-4c1e-b827-a30594d1f601', '28824a91-0059-499d-9c2b-521dd140b884', '4af4c543-89e5-4776-b642-92d2deb387ab'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:29:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0d045351-951b-4010-ad14-ff538e4158c0 tempest-ProjectMemberTests-1676407320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:29:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0d045351-951b-4010-ad14-ff538e4158c0 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:29:42 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0d045351-951b-4010-ad14-ff538e4158c0 tempest-ProjectMemberTests-1676407320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:29:42 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-0d045351-951b-4010-ad14-ff538e4158c0 tempest-ProjectMemberTests-1676407320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:29:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-0d045351-951b-4010-ad14-ff538e4158c0 tempest-ProjectMemberTests-1676407320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:29:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0d045351-951b-4010-ad14-ff538e4158c0 tempest-ProjectMemberTests-1676407320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:42 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:29:42 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:42 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:42 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-0d045351-951b-4010-ad14-ff538e4158c0 tempest-ProjectMemberTests-1676407320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.244s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:42 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-0d045351-951b-4010-ad14-ff538e4158c0 tempest-ProjectMemberTests-1676407320 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:29:42 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-0d045351-951b-4010-ad14-ff538e4158c0 tempest-ProjectMemberTests-1676407320 None] Deleted volume successfully. Nov 03 13:29:42 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-0d045351-951b-4010-ad14-ff538e4158c0 tempest-ProjectMemberTests-1676407320 None] Lock "cinder-ad2549cd-7d7e-422e-8200-26ce78fe7256-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:29:52 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=25,cinder:INSERT=9,cinder:UPDATE=30,cinder:DELETE=2 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:29:52 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:INSERT=9,cinder:UPDATE=33,cinder:SELECT=20,cinder:DELETE=2 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:29:58 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:29:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:29:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:29:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:29:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:29:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:29:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:29:58 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:29:58 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:29:59 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Nov 03 13:29:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.244s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:29:59 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:29:59 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager._thread_info {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:29:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread count: 28 {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:29:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread info: [<_MainThread(MainThread, started 133507074375808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:30:21 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:30:21 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] Flow 'volume_create_manager' (21db9822-a67e-42f8-a282-a7f130f8436a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:30:21 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a097339-0c71-468b-82bd-c2774e1d81c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:30:21 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a097339-0c71-468b-82bd-c2774e1d81c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1246888800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cb94ff3-b929-4e78-8563-9c5833d4e0d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdb6d2270ad54c34a4aa90dc33385af5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:30:22Z,use_quota=True,user_id='c67224557fba464d93773d1a90c6be10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:30:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1f42085-e3db-4c61-8b5f-04326bcc1312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:30:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1f42085-e3db-4c61-8b5f-04326bcc1312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:30:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed29227-96bd-444e-a3c0-2af4766bcb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:30:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed29227-96bd-444e-a3c0-2af4766bcb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cb94ff3-b929-4e78-8563-9c5833d4e0d3', 'volume_name': 'volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:30:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e292908-dc88-42b0-b500-48a5ccabadee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:30:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e292908-dc88-42b0-b500-48a5ccabadee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:30:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f44881-848e-4637-a368-a6bddf6a27cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:30:22 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] Volume 1cb94ff3-b929-4e78-8563-9c5833d4e0d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3', 'volume_size': 1} Nov 03 13:30:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:30:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:30:22 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1246888800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cb94ff3-b929-4e78-8563-9c5833d4e0d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdb6d2270ad54c34a4aa90dc33385af5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:30:22Z,use_quota=True,user_id='c67224557fba464d93773d1a90c6be10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)}" {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:30:22 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] Creating volume 1cb94ff3-b929-4e78-8563-9c5833d4e0d3 {{(pid=86725) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:30:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:30:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:30:22 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:30:22 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:30:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:30:22 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:30:22 devstack cinder-volume[86725]: INFO cinder.volume.drivers.remotefs [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] casted to osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 Nov 03 13:30:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3 1073741824 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:30:22 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3 1073741824 Nov 03 13:30:22 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:30:22 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Nov 03 13:30:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3 1073741824" returned: 0 in 0.412s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:30:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:30:22 devstack sudo[108080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3 Nov 03 13:30:22 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:30:22 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root Nov 03 13:30:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3" returned: 0 in 0.247s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:30:22 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'} {{(pid=86725) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:30:22 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:30:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f44881-848e-4637-a368-a6bddf6a27cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3', 'volume_size': 1}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:30:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c055a5d4-20a1-4a13-aef6-3a31f0219b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:30:22 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] Volume volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3 (1cb94ff3-b929-4e78-8563-9c5833d4e0d3): created successfully Nov 03 13:30:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c055a5d4-20a1-4a13-aef6-3a31f0219b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:30:22 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] Flow 'volume_create_manager' (21db9822-a67e-42f8-a282-a7f130f8436a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:30:22 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-b0e95cc2-ac31-48a5-8acb-5fe860eeaa2f tempest-SnapshotDependencyTests-138191877 None] Created volume successfully. Nov 03 13:30:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f4bf6841-4dbc-4e81-9cf1-40dabc284eef tempest-SnapshotDependencyTests-138191877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:30:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f4bf6841-4dbc-4e81-9cf1-40dabc284eef tempest-SnapshotDependencyTests-138191877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:30:23 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-f4bf6841-4dbc-4e81-9cf1-40dabc284eef tempest-SnapshotDependencyTests-138191877 None] Creating offline snapshot c232caa1-13fd-4233-9596-3d6622e8e99a of volume 1cb94ff3-b929-4e78-8563-9c5833d4e0d3 {{(pid=86725) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:30:23 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fe76d3-04b7-4553-aaf5-c0044ccde367]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:30:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f4bf6841-4dbc-4e81-9cf1-40dabc284eef tempest-SnapshotDependencyTests-138191877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:30:23 devstack sudo[108083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3 Nov 03 13:30:23 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:30:23 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root Nov 03 13:30:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f4bf6841-4dbc-4e81-9cf1-40dabc284eef tempest-SnapshotDependencyTests-138191877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3" returned: 0 in 0.354s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:30:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f4bf6841-4dbc-4e81-9cf1-40dabc284eef tempest-SnapshotDependencyTests-138191877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3.c232caa1-13fd-4233-9596-3d6622e8e99a 1G {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:30:23 devstack sudo[108088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3.c232caa1-13fd-4233-9596-3d6622e8e99a 1G Nov 03 13:30:23 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:30:23 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root Nov 03 13:30:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f4bf6841-4dbc-4e81-9cf1-40dabc284eef tempest-SnapshotDependencyTests-138191877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3.c232caa1-13fd-4233-9596-3d6622e8e99a 1G" returned: 0 in 0.381s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:30:23 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f4bf6841-4dbc-4e81-9cf1-40dabc284eef tempest-SnapshotDependencyTests-138191877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3.c232caa1-13fd-4233-9596-3d6622e8e99a {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:30:23 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3.c232caa1-13fd-4233-9596-3d6622e8e99a Nov 03 13:30:23 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:30:24 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Nov 03 13:30:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f4bf6841-4dbc-4e81-9cf1-40dabc284eef tempest-SnapshotDependencyTests-138191877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3 -F qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3.c232caa1-13fd-4233-9596-3d6622e8e99a" returned: 0 in 0.289s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:30:24 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-f4bf6841-4dbc-4e81-9cf1-40dabc284eef tempest-SnapshotDependencyTests-138191877 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3.c232caa1-13fd-4233-9596-3d6622e8e99a is being set with open permissions: ugo+rw Nov 03 13:30:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f4bf6841-4dbc-4e81-9cf1-40dabc284eef tempest-SnapshotDependencyTests-138191877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3.c232caa1-13fd-4233-9596-3d6622e8e99a {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:30:24 devstack sudo[108098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3.c232caa1-13fd-4233-9596-3d6622e8e99a Nov 03 13:30:24 devstack sudo[108098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:30:24 devstack sudo[108098]: pam_unix(sudo:session): session closed for user root Nov 03 13:30:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f4bf6841-4dbc-4e81-9cf1-40dabc284eef tempest-SnapshotDependencyTests-138191877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3.c232caa1-13fd-4233-9596-3d6622e8e99a" returned: 0 in 0.240s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:30:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f4bf6841-4dbc-4e81-9cf1-40dabc284eef tempest-SnapshotDependencyTests-138191877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:30:24 devstack sudo[108101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3.info Nov 03 13:30:24 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:30:24 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root Nov 03 13:30:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f4bf6841-4dbc-4e81-9cf1-40dabc284eef tempest-SnapshotDependencyTests-138191877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3.info" returned: 0 in 0.255s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:30:24 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-f4bf6841-4dbc-4e81-9cf1-40dabc284eef tempest-SnapshotDependencyTests-138191877 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3.info is being set with open permissions: ugo+rw Nov 03 13:30:24 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f4bf6841-4dbc-4e81-9cf1-40dabc284eef tempest-SnapshotDependencyTests-138191877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3.info {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:30:24 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3.info Nov 03 13:30:24 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:30:25 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Nov 03 13:30:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-f4bf6841-4dbc-4e81-9cf1-40dabc284eef tempest-SnapshotDependencyTests-138191877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3.info" returned: 0 in 0.240s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:30:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-f4bf6841-4dbc-4e81-9cf1-40dabc284eef tempest-SnapshotDependencyTests-138191877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.845s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:30:25 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-f4bf6841-4dbc-4e81-9cf1-40dabc284eef tempest-SnapshotDependencyTests-138191877 None] Create snapshot completed successfully Nov 03 13:30:25 devstack cinder-volume[86725]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:30:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Flow 'volume_create_manager' (d1a46460-32d4-4b77-94df-408c4f238540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:30:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (546185db-9af1-4de2-a7b6-eaf690791c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:30:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (546185db-9af1-4de2-a7b6-eaf690791c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a78f3e6c-2704-41b1-97ba-57486286705b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdb6d2270ad54c34a4aa90dc33385af5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c232caa1-13fd-4233-9596-3d6622e8e99a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:30:26Z,use_quota=True,user_id='c67224557fba464d93773d1a90c6be10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a087b63e-7963-4ff2-a92e-f757996ce6d7),volume_type_id=a087b63e-7963-4ff2-a92e-f757996ce6d7)' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:30:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2802299-e734-4e9f-8b8f-126398be23d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:30:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2802299-e734-4e9f-8b8f-126398be23d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:30:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (025824cc-e074-4075-b772-d20cf06a0d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:30:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (025824cc-e074-4075-b772-d20cf06a0d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a78f3e6c-2704-41b1-97ba-57486286705b', 'volume_name': 'volume-a78f3e6c-2704-41b1-97ba-57486286705b', 'volume_size': 1, 'snapshot_id': 'c232caa1-13fd-4233-9596-3d6622e8e99a'}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:30:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d83596-0233-429e-a6cf-b301fe7d50e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:30:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d83596-0233-429e-a6cf-b301fe7d50e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:30:25 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e77aae-84e8-470d-8403-e13409d47c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:30:25 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Volume a78f3e6c-2704-41b1-97ba-57486286705b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a78f3e6c-2704-41b1-97ba-57486286705b', 'volume_size': 1, 'snapshot_id': 'c232caa1-13fd-4233-9596-3d6622e8e99a'} Nov 03 13:30:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:30:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:30:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Acquiring lock "cinder-quobyte-c232caa1-13fd-4233-9596-3d6622e8e99a-a78f3e6c-2704-41b1-97ba-57486286705b" by "_create_volume_from_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:30:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Lock "cinder-quobyte-c232caa1-13fd-4233-9596-3d6622e8e99a-a78f3e6c-2704-41b1-97ba-57486286705b" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:30:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Creating volume a78f3e6c-2704-41b1-97ba-57486286705b from snapshot c232caa1-13fd-4233-9596-3d6622e8e99a {{(pid=86725) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 13:30:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:30:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:30:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:30:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:30:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:30:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Selected osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43 as target Quobyte volume. {{(pid=86725) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:30:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Acquiring lock "cinder-quobyte-a78f3e6c-2704-41b1-97ba-57486286705b" by "_copy_volume_from_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:30:25 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Lock "cinder-quobyte-a78f3e6c-2704-41b1-97ba-57486286705b" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:30:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] snapshot: c232caa1-13fd-4233-9596-3d6622e8e99a, volume: a78f3e6c-2704-41b1-97ba-57486286705b, {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 13:30:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:30:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:30:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:30:25 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:30:25 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:30:26 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd5ca29-1fef-49a3-aab1-df50b12f94c4]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:30:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3.c232caa1-13fd-4233-9596-3d6622e8e99a {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:30:26 devstack sudo[108107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3.c232caa1-13fd-4233-9596-3d6622e8e99a Nov 03 13:30:26 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:30:26 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root Nov 03 13:30:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3.c232caa1-13fd-4233-9596-3d6622e8e99a" returned: 0 in 0.366s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:30:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:30:26 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3d7680-c67d-4c6d-8365-bb67f2d39e47]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:30:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:30:26 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3 Nov 03 13:30:26 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:30:26 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Nov 03 13:30:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3" returned: 0 in 0.358s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:30:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3 {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 13:30:26 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Creating direct copy from snapshot {{(pid=86725) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 13:30:26 devstack cinder-volume[86725]: DEBUG cinder.utils [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Path /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a78f3e6c-2704-41b1-97ba-57486286705b not found in is_blk_device check {{(pid=86725) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 13:30:26 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a78f3e6c-2704-41b1-97ba-57486286705b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:30:26 devstack sudo[108118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a78f3e6c-2704-41b1-97ba-57486286705b Nov 03 13:30:26 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:30:32 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root Nov 03 13:30:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a78f3e6c-2704-41b1-97ba-57486286705b" returned: 0 in 5.870s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:30:32 devstack cinder-volume[86725]: DEBUG cinder.image.image_utils [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3, size 1024.00 MB, duration 5.87 sec, destination /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a78f3e6c-2704-41b1-97ba-57486286705b {{(pid=86725) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:30:32 devstack cinder-volume[86725]: INFO cinder.image.image_utils [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Converted 1024.00 MB image at 174.42 MB/s Nov 03 13:30:32 devstack cinder-volume[86725]: WARNING cinder.volume.drivers.remotefs [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a78f3e6c-2704-41b1-97ba-57486286705b is being set with open permissions: ugo+rw Nov 03 13:30:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a78f3e6c-2704-41b1-97ba-57486286705b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:30:32 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a78f3e6c-2704-41b1-97ba-57486286705b Nov 03 13:30:32 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:30:32 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Nov 03 13:30:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a78f3e6c-2704-41b1-97ba-57486286705b" returned: 0 in 0.235s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:30:32 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Lock "cinder-quobyte-a78f3e6c-2704-41b1-97ba-57486286705b" released by "_copy_volume_from_snapshot" :: held 6.904s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:30:32 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Lock "cinder-quobyte-c232caa1-13fd-4233-9596-3d6622e8e99a-a78f3e6c-2704-41b1-97ba-57486286705b" released by "_create_volume_from_snapshot" :: held 6.961s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:30:32 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.974s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:30:32 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e77aae-84e8-470d-8403-e13409d47c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a78f3e6c-2704-41b1-97ba-57486286705b', 'volume_size': 1, 'snapshot_id': 'c232caa1-13fd-4233-9596-3d6622e8e99a'}' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:30:32 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fde051e-3334-4915-846d-428122c68e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:30:32 devstack cinder-volume[86725]: INFO cinder.volume.flows.manager.create_volume [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Volume volume-a78f3e6c-2704-41b1-97ba-57486286705b (a78f3e6c-2704-41b1-97ba-57486286705b): created successfully Nov 03 13:30:32 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fde051e-3334-4915-846d-428122c68e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86725) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:30:32 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Flow 'volume_create_manager' (d1a46460-32d4-4b77-94df-408c4f238540) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86725) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:30:32 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-b3251828-dd33-4747-91b6-baad87ff1e41 tempest-SnapshotDependencyTests-138191877 None] Created volume successfully. Nov 03 13:30:33 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-69453c28-8223-451a-bda1-97136bd6464f tempest-SnapshotDependencyTests-138191877 None] Acquiring lock "cinder-c232caa1-13fd-4233-9596-3d6622e8e99a-delete_snapshot" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:30:33 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-69453c28-8223-451a-bda1-97136bd6464f tempest-SnapshotDependencyTests-138191877 None] Lock "cinder-c232caa1-13fd-4233-9596-3d6622e8e99a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:30:33 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-69453c28-8223-451a-bda1-97136bd6464f tempest-SnapshotDependencyTests-138191877 None] Acquiring lock "cinder-quobyte-1cb94ff3-b929-4e78-8563-9c5833d4e0d3" by "delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:30:33 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-69453c28-8223-451a-bda1-97136bd6464f tempest-SnapshotDependencyTests-138191877 None] Lock "cinder-quobyte-1cb94ff3-b929-4e78-8563-9c5833d4e0d3" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:30:33 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-69453c28-8223-451a-bda1-97136bd6464f tempest-SnapshotDependencyTests-138191877 None] Acquiring lock "cinder-quobyte-c232caa1-13fd-4233-9596-3d6622e8e99a" by "_delete_snapshot" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:30:33 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-69453c28-8223-451a-bda1-97136bd6464f tempest-SnapshotDependencyTests-138191877 None] Lock "cinder-quobyte-c232caa1-13fd-4233-9596-3d6622e8e99a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:30:33 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-69453c28-8223-451a-bda1-97136bd6464f tempest-SnapshotDependencyTests-138191877 None] Deleting offline snapshot c232caa1-13fd-4233-9596-3d6622e8e99a of volume 1cb94ff3-b929-4e78-8563-9c5833d4e0d3 {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:30:33 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-69453c28-8223-451a-bda1-97136bd6464f tempest-SnapshotDependencyTests-138191877 None] snapshot_file for this snap is: volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3.c232caa1-13fd-4233-9596-3d6622e8e99a {{(pid=86725) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:30:33 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[4414e460-0110-4e13-8a57-5931eab72324]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:30:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-69453c28-8223-451a-bda1-97136bd6464f tempest-SnapshotDependencyTests-138191877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3.c232caa1-13fd-4233-9596-3d6622e8e99a {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:30:33 devstack sudo[108134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3.c232caa1-13fd-4233-9596-3d6622e8e99a Nov 03 13:30:33 devstack sudo[108134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:30:33 devstack sudo[108134]: pam_unix(sudo:session): session closed for user root Nov 03 13:30:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-69453c28-8223-451a-bda1-97136bd6464f tempest-SnapshotDependencyTests-138191877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3.c232caa1-13fd-4233-9596-3d6622e8e99a" returned: 0 in 0.349s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:30:33 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.remotefs [None req-69453c28-8223-451a-bda1-97136bd6464f tempest-SnapshotDependencyTests-138191877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86725) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:30:33 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df412d0-ebb8-4f18-b89f-34bc0d9f254f]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:30:33 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-69453c28-8223-451a-bda1-97136bd6464f tempest-SnapshotDependencyTests-138191877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:30:34 devstack sudo[108139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3 Nov 03 13:30:34 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:30:34 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root Nov 03 13:30:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-69453c28-8223-451a-bda1-97136bd6464f tempest-SnapshotDependencyTests-138191877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3" returned: 0 in 0.534s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:30:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-69453c28-8223-451a-bda1-97136bd6464f tempest-SnapshotDependencyTests-138191877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3.c232caa1-13fd-4233-9596-3d6622e8e99a {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:30:34 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3.c232caa1-13fd-4233-9596-3d6622e8e99a Nov 03 13:30:34 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:30:34 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Nov 03 13:30:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-69453c28-8223-451a-bda1-97136bd6464f tempest-SnapshotDependencyTests-138191877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3.c232caa1-13fd-4233-9596-3d6622e8e99a" returned: 0 in 0.334s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:30:34 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-69453c28-8223-451a-bda1-97136bd6464f tempest-SnapshotDependencyTests-138191877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3.c232caa1-13fd-4233-9596-3d6622e8e99a {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:30:34 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3.c232caa1-13fd-4233-9596-3d6622e8e99a Nov 03 13:30:34 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:30:35 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Nov 03 13:30:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-69453c28-8223-451a-bda1-97136bd6464f tempest-SnapshotDependencyTests-138191877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3.c232caa1-13fd-4233-9596-3d6622e8e99a" returned: 0 in 0.243s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:30:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-69453c28-8223-451a-bda1-97136bd6464f tempest-SnapshotDependencyTests-138191877 None] Lock "cinder-quobyte-c232caa1-13fd-4233-9596-3d6622e8e99a" released by "_delete_snapshot" :: held 1.557s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:30:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-69453c28-8223-451a-bda1-97136bd6464f tempest-SnapshotDependencyTests-138191877 None] Lock "cinder-quobyte-1cb94ff3-b929-4e78-8563-9c5833d4e0d3" released by "delete_snapshot" :: held 1.578s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:30:35 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-69453c28-8223-451a-bda1-97136bd6464f tempest-SnapshotDependencyTests-138191877 None] Created reservations ['370e4d92-cd4b-4566-b931-c636480e46b8', '9d96aebc-4498-4fe7-b218-6a29fc9e3f9b', 'aa0809c9-6569-4856-b7c2-29845dbeab04', '477fdb31-9cb5-4aac-b5b2-a1af83d7ebdb'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:30:35 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-69453c28-8223-451a-bda1-97136bd6464f tempest-SnapshotDependencyTests-138191877 None] Delete snapshot completed successfully. Nov 03 13:30:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-69453c28-8223-451a-bda1-97136bd6464f tempest-SnapshotDependencyTests-138191877 None] Lock "cinder-c232caa1-13fd-4233-9596-3d6622e8e99a-delete_snapshot" released by "delete_snapshot" :: held 1.714s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:30:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9ace7d4e-8008-42d2-8523-f1dadc621105 tempest-SnapshotDependencyTests-138191877 None] Acquiring lock "cinder-1cb94ff3-b929-4e78-8563-9c5833d4e0d3-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:30:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9ace7d4e-8008-42d2-8523-f1dadc621105 tempest-SnapshotDependencyTests-138191877 None] Lock "cinder-1cb94ff3-b929-4e78-8563-9c5833d4e0d3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:30:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9ace7d4e-8008-42d2-8523-f1dadc621105 tempest-SnapshotDependencyTests-138191877 None] Acquiring lock "cinder-quobyte-1cb94ff3-b929-4e78-8563-9c5833d4e0d3" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:30:35 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9ace7d4e-8008-42d2-8523-f1dadc621105 tempest-SnapshotDependencyTests-138191877 None] Lock "cinder-quobyte-1cb94ff3-b929-4e78-8563-9c5833d4e0d3" acquired by "delete_volume" :: waited 0.014s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:30:35 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5dbbfb-0e62-4766-a374-50d541e506ac]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:30:35 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9ace7d4e-8008-42d2-8523-f1dadc621105 tempest-SnapshotDependencyTests-138191877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:30:35 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3 Nov 03 13:30:35 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:30:36 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Nov 03 13:30:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9ace7d4e-8008-42d2-8523-f1dadc621105 tempest-SnapshotDependencyTests-138191877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3" returned: 0 in 0.352s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:30:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9ace7d4e-8008-42d2-8523-f1dadc621105 tempest-SnapshotDependencyTests-138191877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:30:36 devstack sudo[108160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3 Nov 03 13:30:36 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:30:36 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root Nov 03 13:30:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9ace7d4e-8008-42d2-8523-f1dadc621105 tempest-SnapshotDependencyTests-138191877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-1cb94ff3-b929-4e78-8563-9c5833d4e0d3" returned: 0 in 0.247s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:30:36 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9ace7d4e-8008-42d2-8523-f1dadc621105 tempest-SnapshotDependencyTests-138191877 None] Lock "cinder-quobyte-1cb94ff3-b929-4e78-8563-9c5833d4e0d3" released by "delete_volume" :: held 0.657s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:30:36 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-9ace7d4e-8008-42d2-8523-f1dadc621105 tempest-SnapshotDependencyTests-138191877 None] Created reservations ['43f47267-11f7-4991-bde6-3f75902a651d', 'b858771b-2d35-4125-9f52-632b569e2468', 'ba35b5a8-7105-457d-983c-937f594c2822', '5b4052f3-8e60-4678-a903-d01ee2abd8a0'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:30:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9ace7d4e-8008-42d2-8523-f1dadc621105 tempest-SnapshotDependencyTests-138191877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:30:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9ace7d4e-8008-42d2-8523-f1dadc621105 tempest-SnapshotDependencyTests-138191877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:30:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-9ace7d4e-8008-42d2-8523-f1dadc621105 tempest-SnapshotDependencyTests-138191877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:30:36 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-9ace7d4e-8008-42d2-8523-f1dadc621105 tempest-SnapshotDependencyTests-138191877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:30:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-9ace7d4e-8008-42d2-8523-f1dadc621105 tempest-SnapshotDependencyTests-138191877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:30:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9ace7d4e-8008-42d2-8523-f1dadc621105 tempest-SnapshotDependencyTests-138191877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:30:36 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:30:36 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:30:36 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Nov 03 13:30:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-9ace7d4e-8008-42d2-8523-f1dadc621105 tempest-SnapshotDependencyTests-138191877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.238s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:30:36 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-9ace7d4e-8008-42d2-8523-f1dadc621105 tempest-SnapshotDependencyTests-138191877 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:30:36 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-9ace7d4e-8008-42d2-8523-f1dadc621105 tempest-SnapshotDependencyTests-138191877 None] Deleted volume successfully. Nov 03 13:30:36 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-9ace7d4e-8008-42d2-8523-f1dadc621105 tempest-SnapshotDependencyTests-138191877 None] Lock "cinder-1cb94ff3-b929-4e78-8563-9c5833d4e0d3-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:30:36 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-96287234-468d-4c0f-82bc-6002df23b510 tempest-SnapshotDependencyTests-138191877 None] Acquiring lock "cinder-a78f3e6c-2704-41b1-97ba-57486286705b-delete_volume" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:30:36 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-96287234-468d-4c0f-82bc-6002df23b510 tempest-SnapshotDependencyTests-138191877 None] Lock "cinder-a78f3e6c-2704-41b1-97ba-57486286705b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:30:36 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-96287234-468d-4c0f-82bc-6002df23b510 tempest-SnapshotDependencyTests-138191877 None] Acquiring lock "cinder-quobyte-a78f3e6c-2704-41b1-97ba-57486286705b" by "delete_volume" {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:30:36 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-96287234-468d-4c0f-82bc-6002df23b510 tempest-SnapshotDependencyTests-138191877 None] Lock "cinder-quobyte-a78f3e6c-2704-41b1-97ba-57486286705b" acquired by "delete_volume" :: waited 0.012s {{(pid=86725) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:30:36 devstack cinder-volume[86725]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c3e44b-fd32-46ba-8c90-d788c3fce772]: (4, 'qcow2') {{(pid=88062) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:30:36 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-96287234-468d-4c0f-82bc-6002df23b510 tempest-SnapshotDependencyTests-138191877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a78f3e6c-2704-41b1-97ba-57486286705b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:30:36 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a78f3e6c-2704-41b1-97ba-57486286705b Nov 03 13:30:36 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:30:37 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Nov 03 13:30:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-96287234-468d-4c0f-82bc-6002df23b510 tempest-SnapshotDependencyTests-138191877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a78f3e6c-2704-41b1-97ba-57486286705b" returned: 0 in 0.355s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:30:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-96287234-468d-4c0f-82bc-6002df23b510 tempest-SnapshotDependencyTests-138191877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a78f3e6c-2704-41b1-97ba-57486286705b {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:30:37 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a78f3e6c-2704-41b1-97ba-57486286705b Nov 03 13:30:37 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:30:37 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Nov 03 13:30:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-96287234-468d-4c0f-82bc-6002df23b510 tempest-SnapshotDependencyTests-138191877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049/volume-a78f3e6c-2704-41b1-97ba-57486286705b" returned: 0 in 0.238s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:30:37 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-96287234-468d-4c0f-82bc-6002df23b510 tempest-SnapshotDependencyTests-138191877 None] Lock "cinder-quobyte-a78f3e6c-2704-41b1-97ba-57486286705b" released by "delete_volume" :: held 0.633s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:30:37 devstack cinder-volume[86725]: DEBUG cinder.quota [None req-96287234-468d-4c0f-82bc-6002df23b510 tempest-SnapshotDependencyTests-138191877 None] Created reservations ['192754b2-64da-42e1-b41f-4c23f9485430', '68a84834-82a2-4f8d-8631-8cbf33a0fe1f', '5ae7182a-070c-4f81-9a84-86dd3415acfa', 'dfa2d18e-74cd-4dab-af54-01d915e13d3a'] {{(pid=86725) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:30:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-96287234-468d-4c0f-82bc-6002df23b510 tempest-SnapshotDependencyTests-138191877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:30:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-96287234-468d-4c0f-82bc-6002df23b510 tempest-SnapshotDependencyTests-138191877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:30:37 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-96287234-468d-4c0f-82bc-6002df23b510 tempest-SnapshotDependencyTests-138191877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:30:37 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-96287234-468d-4c0f-82bc-6002df23b510 tempest-SnapshotDependencyTests-138191877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:30:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-96287234-468d-4c0f-82bc-6002df23b510 tempest-SnapshotDependencyTests-138191877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:30:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-96287234-468d-4c0f-82bc-6002df23b510 tempest-SnapshotDependencyTests-138191877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:30:37 devstack sudo[108175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:30:37 devstack sudo[108175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:30:37 devstack sudo[108175]: pam_unix(sudo:session): session closed for user root Nov 03 13:30:37 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-96287234-468d-4c0f-82bc-6002df23b510 tempest-SnapshotDependencyTests-138191877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.233s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:30:37 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-96287234-468d-4c0f-82bc-6002df23b510 tempest-SnapshotDependencyTests-138191877 None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:30:37 devstack cinder-volume[86725]: INFO cinder.volume.manager [None req-96287234-468d-4c0f-82bc-6002df23b510 tempest-SnapshotDependencyTests-138191877 None] Deleted volume successfully. Nov 03 13:30:37 devstack cinder-volume[86725]: DEBUG cinder.coordination [None req-96287234-468d-4c0f-82bc-6002df23b510 tempest-SnapshotDependencyTests-138191877 None] Lock "cinder-a78f3e6c-2704-41b1-97ba-57486286705b-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=86725) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:30:47 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:UPDATE=26,cinder:SELECT=24,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:30:47 devstack cinder-volume[86725]: DEBUG dbcounter [-] [86725] Writing DB stats cinder:SELECT=25,cinder:UPDATE=32,cinder:DELETE=4,cinder:INSERT=8 {{(pid=86725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:30:58 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:30:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:30:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:30:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43': None} {{(pid=86725) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:30:58 devstack cinder-volume[86725]: DEBUG cinder.volume.drivers.quobyte [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49d113b5-b394-4ce9-a01e-c4a8bfbc2e43'] {{(pid=86725) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:30:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.lockutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86725) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:30:58 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:30:58 devstack sudo[108479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049 Nov 03 13:30:58 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:30:59 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root Nov 03 13:30:59 devstack cinder-volume[86725]: DEBUG oslo_concurrency.processutils [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb63bbc003c9a6da7158beb076b16049" returned: 0 in 0.243s {{(pid=86725) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:30:59 devstack cinder-volume[86725]: DEBUG cinder.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Notifying Schedulers of capabilities ... {{(pid=86725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:30:59 devstack cinder-volume[86725]: DEBUG oslo_service.periodic_task [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] Running periodic task VolumeManager._thread_info {{(pid=86725) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:30:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread count: 28 {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:30:59 devstack cinder-volume[86725]: DEBUG cinder.volume.manager [None req-3192d8a0-a1b7-4c8f-a802-75d205dda484 None None] thread info: [<_MainThread(MainThread, started 133507074375808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86725) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}